-- Logs begin at Wed 2021-11-24 14:39:13 UTC, end at Wed 2021-11-24 15:37:54 UTC. -- Nov 24 15:11:21.196284 dv-cinder-804035-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 24 15:11:21.205658 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 24 15:11:21.207796 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 24 15:11:21 2021] *** Nov 24 15:11:21.207796 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 24 15:11:21.207796 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 24 15:11:21.207796 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: nodename: dv-cinder-804035-20-iscsi Nov 24 15:11:21.207796 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: machine: x86_64 Nov 24 15:11:21.207796 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: clock source: unix Nov 24 15:11:21.207796 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: pcre jit disabled Nov 24 15:11:21.207796 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: detected number of CPU cores: 4 Nov 24 15:11:21.207796 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: current working directory: / Nov 24 15:11:21.207796 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: detected binary path: /usr/bin/uwsgi-core Nov 24 15:11:21.207796 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: your processes number limit is 47680 Nov 24 15:11:21.207796 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: your memory page size is 4096 bytes Nov 24 15:11:21.207796 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: detected max file descriptor number: 2048 Nov 24 15:11:21.207796 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: lock engine: pthread robust mutexes Nov 24 15:11:21.208584 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: thunder lock: enabled Nov 24 15:11:21.208584 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 24 15:11:21.208584 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 24 15:11:21.252219 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: Python main interpreter initialized at 0x559e286689c0 Nov 24 15:11:21.252219 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: python threads support enabled Nov 24 15:11:21.252219 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: your server socket listen backlog is limited to 100 connections Nov 24 15:11:21.252219 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: your mercy for graceful operations on workers is 90 seconds Nov 24 15:11:21.252585 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: mapped 403077 bytes (393 KB) for 2 cores Nov 24 15:11:21.252657 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: *** Operational MODE: preforking *** Nov 24 15:11:21.252899 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: *** uWSGI is running in multiple interpreter mode *** Nov 24 15:11:21.252899 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: spawned uWSGI master process (pid: 101849) Nov 24 15:11:21.253105 dv-cinder-804035-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 24 15:11:21.253668 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: spawned uWSGI worker 1 (pid: 101850, cores: 1) Nov 24 15:11:21.254011 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: spawned uWSGI worker 2 (pid: 101851, cores: 1) Nov 24 15:11:21.254173 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 24 15:11:22.839879 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 15:11:22.839879 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: from cryptography.utils import int_from_bytes Nov 24 15:11:22.841050 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 15:11:22.841050 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: from cryptography.utils import int_from_bytes Nov 24 15:11:22.850258 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 15:11:22.850258 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: from cryptography.utils import int_from_bytes Nov 24 15:11:22.850752 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 15:11:22.850752 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: from cryptography.utils import int_from_bytes Nov 24 15:11:25.330348 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 15:11:25.330919 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 15:11:25.331266 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 15:11:25.331372 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 15:11:25.331453 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 15:11:25.331530 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 15:11:25.331610 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 15:11:25.331695 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 15:11:25.331772 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 15:11:25.331847 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 15:11:25.332073 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.332195 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.332394 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.332523 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.332713 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.332848 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.333030 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.333170 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.333357 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.333496 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.333672 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.333807 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.333993 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.334114 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.334315 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.334417 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.334639 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.334745 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.334920 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.335036 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.335235 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.335356 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.335559 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-20-iscsi {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.335682 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-20-iscsi {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.335879 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.336006 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.336185 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.336320 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.336496 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.336635 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.336812 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.336956 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.337114 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.337262 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.337435 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.337586 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.337748 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.337893 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.338248 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.338412 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.338676 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.338756 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.339002 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.339091 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.339314 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.339412 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.339655 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.339750 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.339982 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.340070 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.340301 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.340395 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.340625 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.340711 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.340932 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.341034 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.341255 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.341349 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.341565 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.341653 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.341962 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-20-iscsi {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.342050 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-20-iscsi {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.342279 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.342375 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.342592 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.342685 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.342933 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.343023 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.343348 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.343516 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.343672 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.343825 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.343976 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.344116 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.344259 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.344411 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.344577 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.344699 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.344888 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.344986 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.345212 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.345331 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.345532 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.345616 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.345853 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.345950 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.346173 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.346277 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.346496 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.346602 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.346786 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.346919 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.347114 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.347211 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.347426 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.347567 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.347711 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.347844 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.348015 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.348164 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.348306 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.348439 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.348572 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.348714 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.348857 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.349029 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.349168 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.349301 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.349481 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.349641 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.349785 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.349990 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.350133 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.350268 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.350426 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.350562 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.350703 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.350874 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.351216 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.351361 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.351505 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.351646 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.351787 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.351920 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.352061 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.352195 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.352349 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.352484 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.352617 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.352758 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.352892 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.353024 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.353166 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.353307 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.353441 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.353573 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.353713 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.353855 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.354123 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.354278 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.354415 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.354556 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.354709 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.354949 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.355105 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.355244 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.355380 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.355514 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.355648 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.355794 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.355929 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.356089 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.356233 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.356366 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.356508 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.356687 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.356831 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.356965 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.357099 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.357273 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.357423 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.357580 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.357721 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.357885 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.358036 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.358191 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.358348 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.358512 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.358653 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.358862 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.359009 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.359170 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.359323 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.359458 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.359600 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.359734 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.359867 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.360011 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.360154 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.360288 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.360427 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.360602 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.360742 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.360909 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.361065 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.361201 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.361334 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.361571 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.361718 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.361886 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.362183 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.362322 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.362495 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.362641 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.363081 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.363235 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.363393 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.363541 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.363746 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.363896 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.364030 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.364175 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.364329 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.364462 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.364595 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.364766 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.364923 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.365144 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.365317 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.365499 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.365647 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.365781 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.365927 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.366062 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.366194 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.366338 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.366550 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.366685 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.366847 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.367002 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.367146 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.367279 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.367411 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.367551 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.367693 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.367836 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.367978 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.368119 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.368263 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.368431 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.368569 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.368711 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.368952 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.369107 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.369244 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.369375 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.369517 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.369650 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.369783 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.369915 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.370046 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.370190 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.370333 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.370466 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.370598 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.370730 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.370892 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.371036 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.371183 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.371873 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.372008 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.372141 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.372274 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.372414 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.372568 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.372702 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.372834 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.372976 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.373110 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.373252 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.373386 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.373517 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.373657 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.373790 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.373957 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.374107 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.374277 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.374425 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.374588 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.374729 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.374916 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.375071 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.375292 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.375435 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.375577 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:11:25.375711 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.375875 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.376023 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.376176 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.376320 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.376491 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.376632 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.376806 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.376953 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.377137 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.377279 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.377470 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.377610 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.377787 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.377928 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.378100 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.378256 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.378413 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.378584 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.378731 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.378968 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.379107 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.379240 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.379382 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.379530 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.379671 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.379806 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.379961 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.380101 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.380279 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.380443 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.380594 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.380729 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.380913 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.381053 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.381229 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.381368 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.381546 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.381694 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.381857 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.381998 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.382174 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.382332 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.382491 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.382629 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.382889 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.383033 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.383178 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.383320 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.383463 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.383597 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.383797 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.383945 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.384108 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.384269 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.384431 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.384570 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.384743 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.384884 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.385063 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.385206 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.385429 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.385569 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.385710 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.385845 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.385988 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.386122 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.386265 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.386400 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.386602 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.386746 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.386955 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.387612 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.387791 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.387934 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.388110 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.388252 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.388461 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.388596 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.388729 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.388873 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.389008 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.389141 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.389283 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.389418 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.389601 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.389740 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.389911 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.390066 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.390225 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.390363 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.390552 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.390691 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.390876 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.391029 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.391166 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.391299 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.391483 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.391631 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.391795 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.391946 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.392089 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.392223 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.392398 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.392546 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.392690 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.392831 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.393004 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.393144 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.393311 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.393451 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.393619 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.393765 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.393934 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.394100 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.394238 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.394370 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.394537 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.394688 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.394875 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.395016 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.395149 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.395283 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.395443 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.395589 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.395730 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.395864 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.396044 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.396194 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.396342 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.396477 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.396665 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.396813 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.396977 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.397126 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.397286 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.397427 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.397619 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.397759 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.397948 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.398114 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.398251 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.398383 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.398562 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.398703 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.398896 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.399050 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.399213 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.399353 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.399518 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.399657 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.399828 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.399978 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.400135 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.400276 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.400418 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.400563 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.400705 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.400839 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.401005 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.401146 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.401310 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.401459 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.401606 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.401740 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.401906 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.402072 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.402208 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.402347 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.402523 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.402664 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.402850 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.402995 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.403158 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.403297 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.403451 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.403594 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.403751 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.403890 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.404055 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.404199 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.404383 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.404535 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.404678 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.404820 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.405019 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.405171 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.405356 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.405496 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.405673 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.405815 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.405991 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.406149 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.406283 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.406415 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.406601 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.406741 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.406950 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.407099 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.407240 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.407378 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.407511 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.407643 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.407826 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.407969 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.408145 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.408283 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.408455 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.408595 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.408775 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.408918 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.409086 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.409224 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.409406 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.409546 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.409712 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.409854 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.410028 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.410167 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.410418 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.410606 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.410755 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.410936 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.411094 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.411236 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.411375 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.411514 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.411663 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.411802 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.411941 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.412082 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.412220 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.412369 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.412526 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.412667 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.412813 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.412954 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.413118 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.413274 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.413415 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.413560 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.413722 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.413868 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.414040 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.414194 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.414335 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.414483 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.414653 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.414848 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.415000 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.415153 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.415295 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.415440 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.415589 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.415729 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.415877 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.416018 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.416187 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.416334 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.416484 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.416623 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.416836 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.416979 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.417126 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.417266 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.417415 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.417567 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.417717 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.417858 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.418020 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.418199 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.418355 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.418500 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.418652 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.418793 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.418977 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.419119 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.419259 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.419409 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.419550 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.419690 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.419830 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.419969 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.420146 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.420313 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.420456 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.420595 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.420735 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.420874 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.421040 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.421195 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.421337 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.421508 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.421650 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.421790 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.421931 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.422078 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.422229 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.422369 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.422510 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.422656 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.422843 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.423002 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.423144 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.423282 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.423454 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.423601 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.423776 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.423924 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.424064 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.424213 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.424360 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.424500 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.424679 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.424827 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.424967 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.425105 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.425272 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.425426 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.425575 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.425716 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.425863 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.426003 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.426188 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.426336 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.426484 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.426625 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.426790 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.426968 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.427133 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.427289 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.427431 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.427575 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.427746 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.427892 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.428042 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.428190 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.428354 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.428498 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.428662 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.428809 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.428974 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.429128 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.429270 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.429408 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.429587 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.429734 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.429897 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.430060 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.430202 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.430340 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.430501 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.430648 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.430800 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.430977 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.431145 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.431292 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.431455 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.431600 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.431756 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.431895 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.432046 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.432193 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.432333 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.432480 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.432629 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.432931 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.433079 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.433265 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.433489 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.433635 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.434388 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.434587 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.434731 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.434918 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.435063 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.435221 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.435371 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.435518 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.435658 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.435798 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.435961 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.436118 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.436288 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.436434 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.436598 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.436755 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.436895 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.437043 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.437192 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.437333 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.437497 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.437644 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.437793 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.437947 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.438092 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.438233 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.438372 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.438513 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.438671 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.438872 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.439022 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.439161 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.439302 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.439441 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.439591 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.439732 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.439872 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.440011 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.440187 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.440345 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.440486 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.440649 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.440799 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.441016 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.441166 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.441306 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.441447 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.441593 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.441742 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.441882 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.442022 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.442161 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.442362 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.442510 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.442671 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.442876 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.443036 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.443178 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.443326 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.443467 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.443616 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.443764 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.443905 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.444045 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.444185 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.444333 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.444485 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.444626 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.444766 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.444913 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.445055 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.445208 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.445349 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.445525 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.445667 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.445806 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.445954 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.446104 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.446245 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.446394 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.446534 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.446674 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.446868 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.447028 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.447177 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.447317 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.447456 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.447595 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.447742 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.447896 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.448043 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.448182 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.448332 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.448471 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.448618 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.448759 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.448898 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.449077 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.449230 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.449394 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.450110 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.450260 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.450400 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.450539 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.450689 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.450854 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.451013 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.451156 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.451303 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.451444 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.451584 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.451731 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.451880 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.452028 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.452175 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.452315 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.452461 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.452620 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.452768 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.452909 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.453049 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.453195 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.453343 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.453499 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.453641 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.453782 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.453928 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.454076 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.454312 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.454467 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.454620 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.454760 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.454957 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.455099 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.455252 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.455394 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.455541 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.455682 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.455828 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.455969 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.456122 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.456264 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.456404 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.456554 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.456694 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.456840 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.456990 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.457132 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.457273 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.457412 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.457552 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.457692 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.457843 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.457994 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.458143 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.458291 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.458442 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.458595 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.458738 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.458917 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.459014 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.459097 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.459177 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.459407 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.459525 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.459717 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.459815 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.460017 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.460102 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.460322 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.460411 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.460626 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.460719 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.460926 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.461018 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.461249 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.461342 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.461552 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.461642 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.461854 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.461946 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.462156 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.462241 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.462457 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.462551 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.462796 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.462915 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.463122 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.463207 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.463475 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.463565 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.463780 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.463869 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.464099 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.464194 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.464410 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.464493 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.464719 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.464810 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.465051 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.465147 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.465364 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.465447 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.465669 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.465804 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.465991 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.466196 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.466307 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.466443 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.466597 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.466764 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.466946 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.467091 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.467232 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.467381 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.467531 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.467674 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.467814 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.467954 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.468116 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.468273 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.468427 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.468569 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.468745 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.468969 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.469130 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.469282 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.469499 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.469642 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.469784 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.469923 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.470062 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.470231 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.470374 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.470514 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.470653 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.470794 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.470981 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.471134 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.471275 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.471414 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.471553 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.471693 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.471833 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.471986 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.472138 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.472285 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.472427 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.472573 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.472714 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.472871 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.473016 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.473157 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.473305 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.473453 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.473606 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.473753 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.473903 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.474053 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.474193 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.474333 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.474481 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.474622 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.474762 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.474935 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.475079 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.475225 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.475375 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.475525 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.475666 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.475905 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.476054 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.476225 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.476381 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.476635 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.476784 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.476924 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.477110 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.477267 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.477434 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.477582 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.477734 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.477876 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.478056 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.478213 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.478376 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.478524 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.478686 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.478938 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.479134 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.479295 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.479437 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.479575 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.479746 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.479903 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.480051 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.480211 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.480353 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.480499 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.481161 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.481320 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.481526 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.481673 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.481821 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.481961 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.482107 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.482248 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.482402 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.482543 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.482701 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.482866 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.483013 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.483174 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.483327 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.483468 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.483608 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.483747 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.483973 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.484119 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.484271 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.484427 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.484629 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.484776 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.484974 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.485129 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.485277 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.485425 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.485592 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.485739 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.485914 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.486070 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.486236 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.486390 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.486545 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.486697 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.486883 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.487046 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.487189 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.487329 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.487469 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.487616 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.488007 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.488161 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.488302 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.488441 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.488615 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.488770 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.488929 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.489071 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.489217 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.489359 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.489541 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.489691 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.489841 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.489982 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.490160 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.490307 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.490503 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.490649 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.490902 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.491051 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.491216 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.491367 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.491508 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.491649 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.491830 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.491979 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.492128 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.492270 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.492410 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.492550 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.492721 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.492886 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.493036 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.493185 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.493332 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.493480 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.493623 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.493777 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.493919 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.494060 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.494201 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.494341 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.494502 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.494664 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.494867 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.495017 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.495158 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.495299 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.495439 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.495587 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.495736 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.495884 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.496027 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.496167 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.496360 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.496520 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.496669 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.496823 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.496965 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.497105 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.497278 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.497427 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.497568 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.497708 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.497887 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.498035 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.498185 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.498327 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.498467 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.498613 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.498764 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.498942 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.499097 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.499240 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.499406 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.499555 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.499718 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.499865 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.500037 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.500187 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.500366 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.500514 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.500693 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.500854 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.500997 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.501145 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.501322 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.501471 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.501649 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.501805 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.501947 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.502087 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.502271 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.502420 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.502596 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.502762 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.502955 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.503098 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.503239 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.503379 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.503526 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.503686 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.503829 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.503976 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.504117 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.504265 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.504415 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.504556 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.504715 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.504914 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.505058 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.505198 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.505352 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.505494 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.505634 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.505773 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.505920 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.506061 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.506210 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.506352 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.506504 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.506646 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.506786 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.506951 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.507104 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.507246 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.507394 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.507536 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.507676 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.507990 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.508154 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.508298 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.508440 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.508593 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.508735 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.508889 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.509039 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.509195 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.509338 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.509500 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.509649 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.509802 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.509944 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.510085 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.510231 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.510374 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.510526 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.510677 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.510885 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.511045 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.511187 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.511329 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.511478 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.511622 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.511763 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.512414 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.512558 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.512707 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.512858 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.513015 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.513198 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.513349 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.513490 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.513639 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.513791 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.513934 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.514121 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.514265 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.514418 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.514564 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.514715 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.514894 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.515040 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.515213 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.515372 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.515590 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.515734 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.515876 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.516017 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.516334 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.516486 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.516645 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.516795 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.516939 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.517106 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.517253 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.517396 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.517545 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.517688 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.517830 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.517972 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.518124 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.518279 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.518423 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.518572 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.518714 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.518921 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.519068 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.519221 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.519364 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.519514 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.519657 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.519807 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.519973 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.520082 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.520169 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.520277 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.520465 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.520564 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.520802 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.520889 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.521117 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.521209 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.521425 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.521525 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.521735 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.521820 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.522060 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.522147 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.522355 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.522449 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.522665 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.522748 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.522997 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.523094 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.523308 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.523407 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.523616 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.523713 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.523931 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.524089 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.524234 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.524399 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.524543 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.524684 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.524849 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.524996 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.525168 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.525317 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.525481 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.525629 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.525782 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.525931 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.526088 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.526245 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.526410 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.526591 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.526763 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.526946 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.527251 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.527399 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.527644 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.527877 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.528079 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.528235 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.528379 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.528562 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.528724 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.528877 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.529019 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.529200 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.529345 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.529487 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.529629 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.529777 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.529919 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.530069 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.530218 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.530366 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.530508 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.530668 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.530845 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.531006 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.531150 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.531291 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.531441 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.531585 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.531739 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.531881 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.532022 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.532163 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.532303 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.532454 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.532605 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.532760 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.532988 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.533154 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.533373 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.533529 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.533681 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.533823 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.533977 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.534119 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.534259 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.534408 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.534647 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.534795 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.534981 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.535123 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.535265 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.535418 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.535561 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.535702 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.535843 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.535984 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.536133 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.536284 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.536442 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.536597 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.536744 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.536888 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.537028 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.537178 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.537319 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.537460 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.537600 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.537741 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.537881 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.538101 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.538246 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.538397 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.538538 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.538678 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.538846 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.538996 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.539136 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.539277 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.539417 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.539558 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.539710 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.539853 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.539994 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.540136 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.540286 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.540428 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.540581 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.540725 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.540866 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.541008 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.541157 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.541299 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.541451 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.541594 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.541735 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.541876 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.542017 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.542177 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.542320 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.542468 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.542611 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.542751 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.542918 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.543071 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.543816 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.543965 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.544107 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.544248 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.544400 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.544554 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.544707 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.544855 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.545003 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.545145 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.545294 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.545444 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.545626 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.545767 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.545908 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.546048 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.546198 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.546355 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.546501 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.546653 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.546891 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.547046 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.547201 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.547345 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.547580 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.547734 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.547924 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.548097 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.548254 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.548422 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.548570 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.548767 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.548925 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.549130 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.549288 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.549438 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.549580 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.549727 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.549869 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.550018 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.550161 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.550302 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.550444 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.550607 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.550766 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.550947 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.551090 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.551239 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.551380 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.551550 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.551765 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.551920 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.552062 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.552210 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.552352 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.552493 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.552653 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.552796 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.552936 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.553077 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.553225 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.553367 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.553526 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.553669 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.553829 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.554045 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.554191 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.554349 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.554552 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.554710 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.554885 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.555035 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.555176 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.555326 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.555477 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.555619 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.555761 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.555901 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.556045 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.556194 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.556336 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.556488 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.556639 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.556782 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.556928 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.557087 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.557239 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.557381 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.557521 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.557711 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.557876 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.558021 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.558169 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.558311 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.558463 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.558632 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.558941 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.559105 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.559247 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.559397 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.559537 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.559678 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.559833 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.559977 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.560125 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.560274 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.560428 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.560569 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.560718 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.560884 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.561034 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.561183 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.561332 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.561483 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.561632 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.561775 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.561915 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.562067 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.562220 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.562370 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.562514 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.562702 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.562876 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.563026 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.563167 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.563351 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.563502 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.563644 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.563785 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.563983 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.564237 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.564396 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.564543 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.564692 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.564841 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.564983 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.565134 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.565275 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.565428 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.565570 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.565717 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.565870 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.566021 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.566173 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.566321 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.566470 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.566618 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.566777 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.567064 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.567219 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.567368 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.567519 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.567662 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.567811 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.567964 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.568107 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.568266 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.568409 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.568557 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.568708 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.568907 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.569111 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.569263 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.569406 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.569548 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.569699 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.569842 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.569991 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.570144 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.570285 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.570435 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.570578 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.570719 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.570890 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.571039 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.571180 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.571330 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.571472 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.571620 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.571769 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.571910 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.572063 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.572212 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.572362 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.572504 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.572645 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.572785 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.572935 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.573083 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.573226 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.573367 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.573519 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.573661 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.573819 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.573971 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.574113 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.574894 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.575051 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.575203 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.575356 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.575505 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.575653 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.575800 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.575950 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.576100 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.576251 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.576406 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.576547 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 15:11:25.576697 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.576922 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.577233 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:11:25.577481 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 15:11:25.599243 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG oslo_db.sqlalchemy.engines [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:11:25.600308 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_db.sqlalchemy.engines [None req-5a8526df-7a68-485e-8b41-97c80d97b893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:11:25.665881 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.context [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),394dac41-edff-43f6-a3ed-5e4ac19075b2(cell1) {{(pid=101850) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 15:11:25.666317 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.context [None req-5a8526df-7a68-485e-8b41-97c80d97b893 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),394dac41-edff-43f6-a3ed-5e4ac19075b2(cell1) {{(pid=101851) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 15:11:25.670175 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:11:25.670569 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-5a8526df-7a68-485e-8b41-97c80d97b893 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:11:25.671794 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:11:25.672176 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-5a8526df-7a68-485e-8b41-97c80d97b893 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:11:25.672607 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:11:25.672976 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-5a8526df-7a68-485e-8b41-97c80d97b893 None None] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:11:25.674551 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG oslo_concurrency.lockutils [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:11:25.674916 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-5a8526df-7a68-485e-8b41-97c80d97b893 None None] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:11:25.685228 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG oslo_db.sqlalchemy.engines [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:11:25.687961 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_db.sqlalchemy.engines [None req-5a8526df-7a68-485e-8b41-97c80d97b893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:11:25.690276 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_db.sqlalchemy.engines [None req-5a8526df-7a68-485e-8b41-97c80d97b893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:11:25.693291 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG oslo_db.sqlalchemy.engines [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:11:25.946481 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_db.sqlalchemy.engines [None req-5a8526df-7a68-485e-8b41-97c80d97b893 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:11:25.950500 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG oslo_db.sqlalchemy.engines [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:11:26.291257 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: WARNING keystonemiddleware.auth_token [None req-5a8526df-7a68-485e-8b41-97c80d97b893 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 15:11:26.291418 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: WARNING keystonemiddleware.auth_token [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 15:11:26.297757 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: WARNING keystonemiddleware.auth_token [None req-5a8526df-7a68-485e-8b41-97c80d97b893 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 15:11:26.297908 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: WARNING keystonemiddleware.auth_token [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 15:11:26.519410 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: WARNING keystonemiddleware.auth_token [None req-5a8526df-7a68-485e-8b41-97c80d97b893 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 15:11:26.520274 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: WARNING keystonemiddleware.auth_token [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 15:11:26.524534 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: WARNING keystonemiddleware.auth_token [None req-5a8526df-7a68-485e-8b41-97c80d97b893 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 15:11:26.525363 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: WARNING keystonemiddleware.auth_token [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 15:11:26.529930 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559e286689c0 pid: 101851 (default app) Nov 24 15:11:26.530671 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x559e286689c0 pid: 101850 (default app) Nov 24 15:11:26.532001 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-5a8526df-7a68-485e-8b41-97c80d97b893 None None] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:11:26.533177 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-5a8526df-7a68-485e-8b41-97c80d97b893 None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001714 Nov 24 15:11:26.533590 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Wed Nov 24 15:11:26 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:12:47.201763 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:12:47.203718 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002656 Nov 24 15:12:47.204565 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 1/2] 10.222.0.66 () {54 vars in 930 bytes} [Wed Nov 24 15:12:47 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:12:47.749832 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-32976046-1cec-450a-90bc-2ba4ab434c4a admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:12:47.779073 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-32976046-1cec-450a-90bc-2ba4ab434c4a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.568466 Nov 24 15:12:47.779815 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 2/3] 10.222.0.66 () {60 vars in 1291 bytes} [Wed Nov 24 15:12:47 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:12:50.069572 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:12:50.070512 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-870f9184-dfaa-435b-956a-6048e7fa87a1 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Nov 24 15:12:50.071125 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 2/4] 10.222.0.66 () {54 vars in 930 bytes} [Wed Nov 24 15:12:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:12:50.133195 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-e031ecb1-5dd1-4e4c-a037-6f039c67b908 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "name": "cirros256", "ram": 256, "id": "c1", "vcpus": 1}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:12:50.152703 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:12:50.152703 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: warnings.warn(msg) Nov 24 15:12:50.182887 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-e031ecb1-5dd1-4e4c-a037-6f039c67b908 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105225 Nov 24 15:12:50.183602 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 3/5] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Nov 24 15:12:50 2021] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:12:50.521837 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-18202096-3ae9-4740-9d13-825f0eb0fe0b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:12:50.524237 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:12:50.524237 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: warnings.warn(msg) Nov 24 15:12:50.572633 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-18202096-3ae9-4740-9d13-825f0eb0fe0b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.380658 Nov 24 15:12:50.579963 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 3/6] 10.222.0.66 () {64 vars in 1335 bytes} [Wed Nov 24 15:12:50 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:12:52.896228 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-e031ecb1-5dd1-4e4c-a037-6f039c67b908 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:12:52.897176 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-e031ecb1-5dd1-4e4c-a037-6f039c67b908 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Nov 24 15:12:52.897594 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 4/7] 10.222.0.66 () {54 vars in 930 bytes} [Wed Nov 24 15:12:52 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:12:53.015599 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-939ce60b-273a-4500-b0cc-ff3a2ee0e5d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "swap": 0}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:12:53.033474 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:12:53.033474 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: warnings.warn(msg) Nov 24 15:12:53.053813 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-939ce60b-273a-4500-b0cc-ff3a2ee0e5d7 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149869 Nov 24 15:12:53.054593 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 4/8] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Nov 24 15:12:52 2021] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:12:53.067022 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-71971fc1-b614-4f40-b8be-6d0c32f381f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:12:53.068496 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:12:53.068496 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: warnings.warn(msg) Nov 24 15:12:53.103073 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-71971fc1-b614-4f40-b8be-6d0c32f381f2 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039577 Nov 24 15:12:53.111012 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 5/9] 10.222.0.66 () {64 vars in 1335 bytes} [Wed Nov 24 15:12:53 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:12:55.404043 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-939ce60b-273a-4500-b0cc-ff3a2ee0e5d7 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:12:55.405045 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-939ce60b-273a-4500-b0cc-ff3a2ee0e5d7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Nov 24 15:12:55.405716 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 5/10] 10.222.0.66 () {54 vars in 930 bytes} [Wed Nov 24 15:12:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:12:55.469406 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-6c4065ce-4ca9-4de6-aa7c-8feaeb26f046 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:12:55.488834 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-6c4065ce-4ca9-4de6-aa7c-8feaeb26f046 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076784 Nov 24 15:12:55.489675 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 6/11] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Nov 24 15:12:55 2021] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:12:55.502320 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-09f5cc89-e96f-4e64-8c18-43652aaa1ff9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:12:55.529391 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-09f5cc89-e96f-4e64-8c18-43652aaa1ff9 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031042 Nov 24 15:12:55.530994 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 6/12] 10.222.0.66 () {64 vars in 1335 bytes} [Wed Nov 24 15:12:55 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:12:57.831864 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-6c4065ce-4ca9-4de6-aa7c-8feaeb26f046 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:12:57.832880 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-6c4065ce-4ca9-4de6-aa7c-8feaeb26f046 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Nov 24 15:12:57.833286 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 7/13] 10.222.0.66 () {54 vars in 930 bytes} [Wed Nov 24 15:12:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:12:57.898892 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-829a56b6-7400-4a6b-8345-75ae630b66c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "swap": 0}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:12:57.919476 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-829a56b6-7400-4a6b-8345-75ae630b66c2 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079942 Nov 24 15:12:57.920313 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 7/14] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Nov 24 15:12:57 2021] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:12:57.932624 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-fd3d72e2-fb21-4b12-9ea1-065ba073ae3c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:12:57.960573 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-fd3d72e2-fb21-4b12-9ea1-065ba073ae3c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031996 Nov 24 15:12:57.961314 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 8/15] 10.222.0.66 () {64 vars in 1335 bytes} [Wed Nov 24 15:12:57 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:13:00.250424 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-829a56b6-7400-4a6b-8345-75ae630b66c2 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:00.251527 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-829a56b6-7400-4a6b-8345-75ae630b66c2 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Nov 24 15:13:00.252253 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 8/16] 10.222.0.66 () {54 vars in 930 bytes} [Wed Nov 24 15:13:00 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:00.313549 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-08a83f1b-3263-4811-a6a2-c7f4557f93ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:00.334909 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-08a83f1b-3263-4811-a6a2-c7f4557f93ee admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074004 Nov 24 15:13:00.336114 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 9/17] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Nov 24 15:13:00 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:13:00.348130 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-bbe12b91-3fde-45ae-9e93-7822682fa4a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:00.372393 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-bbe12b91-3fde-45ae-9e93-7822682fa4a3 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027821 Nov 24 15:13:00.373221 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 9/18] 10.222.0.66 () {64 vars in 1335 bytes} [Wed Nov 24 15:13:00 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:13:02.836316 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-08a83f1b-3263-4811-a6a2-c7f4557f93ee admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:02.838130 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-08a83f1b-3263-4811-a6a2-c7f4557f93ee admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002627 Nov 24 15:13:02.838847 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 10/19] 10.222.0.66 () {54 vars in 930 bytes} [Wed Nov 24 15:13:02 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:02.911908 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-6911e27c-a54b-42f9-8af6-b5c7d0b16506 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:02.937284 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-6911e27c-a54b-42f9-8af6-b5c7d0b16506 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.087969 Nov 24 15:13:02.937848 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 10/20] 10.222.0.66 () {60 vars in 1291 bytes} [Wed Nov 24 15:13:02 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:13:05.324624 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-08a83f1b-3263-4811-a6a2-c7f4557f93ee admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:05.325948 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-08a83f1b-3263-4811-a6a2-c7f4557f93ee admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001882 Nov 24 15:13:05.326508 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 11/21] 10.222.0.66 () {54 vars in 930 bytes} [Wed Nov 24 15:13:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:05.385974 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-5bd1afbf-b669-489c-9738-f8b02b310adf admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "id": "1", "swap": 0}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:05.404576 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-5bd1afbf-b669-489c-9738-f8b02b310adf admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.071761 Nov 24 15:13:05.405137 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 11/22] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Nov 24 15:13:05 2021] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:13:05.417870 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-4a6065e4-547c-4dc9-a8a1-c973f2631758 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:05.440928 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-4a6065e4-547c-4dc9-a8a1-c973f2631758 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027065 Nov 24 15:13:05.441546 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 12/23] 10.222.0.66 () {64 vars in 1332 bytes} [Wed Nov 24 15:13:05 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:13:07.939102 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-5bd1afbf-b669-489c-9738-f8b02b310adf admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:07.940162 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-5bd1afbf-b669-489c-9738-f8b02b310adf admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Nov 24 15:13:07.940593 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 12/24] 10.222.0.66 () {54 vars in 930 bytes} [Wed Nov 24 15:13:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:08.002135 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-2b8c06c7-7a65-482c-a90f-b67620cd1331 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "id": "2", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:08.019540 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-2b8c06c7-7a65-482c-a90f-b67620cd1331 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072609 Nov 24 15:13:08.020105 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 13/25] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Nov 24 15:13:07 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:13:08.032946 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-4f324a64-1dbe-4435-84d0-e05f0da18338 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:08.057533 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-4f324a64-1dbe-4435-84d0-e05f0da18338 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028250 Nov 24 15:13:08.058109 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 13/26] 10.222.0.66 () {64 vars in 1332 bytes} [Wed Nov 24 15:13:08 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:13:10.327898 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-2b8c06c7-7a65-482c-a90f-b67620cd1331 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:10.329033 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-2b8c06c7-7a65-482c-a90f-b67620cd1331 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Nov 24 15:13:10.329532 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 14/27] 10.222.0.66 () {54 vars in 930 bytes} [Wed Nov 24 15:13:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:10.385625 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-bf8e577c-676b-45bd-ba00-af22cddf6a89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 40, "name": "m1.medium"}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:10.409498 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-bf8e577c-676b-45bd-ba00-af22cddf6a89 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073451 Nov 24 15:13:10.410392 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 14/28] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Nov 24 15:13:10 2021] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:13:10.423514 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-834d5310-30e0-4ecb-964f-43bcc9ae0e1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:10.446751 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-834d5310-30e0-4ecb-964f-43bcc9ae0e1b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027217 Nov 24 15:13:10.447348 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 15/29] 10.222.0.66 () {64 vars in 1332 bytes} [Wed Nov 24 15:13:10 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:13:12.766382 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-bf8e577c-676b-45bd-ba00-af22cddf6a89 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:12.768141 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-bf8e577c-676b-45bd-ba00-af22cddf6a89 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002182 Nov 24 15:13:12.768610 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 15/30] 10.222.0.66 () {54 vars in 930 bytes} [Wed Nov 24 15:13:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:12.833049 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-1b499cec-855d-4be4-a634-6c066e927b96 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "id": "4", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "os-flavor-access:is_public": true, "ram": 8192}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:12.852443 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-1b499cec-855d-4be4-a634-6c066e927b96 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076962 Nov 24 15:13:12.853004 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 16/31] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Nov 24 15:13:12 2021] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:13:12.867297 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-0957d275-2df0-4b50-83a2-66b28eefebc1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:12.891523 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-0957d275-2df0-4b50-83a2-66b28eefebc1 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028805 Nov 24 15:13:12.892463 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 16/32] 10.222.0.66 () {64 vars in 1332 bytes} [Wed Nov 24 15:13:12 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:13:15.236745 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-1b499cec-855d-4be4-a634-6c066e927b96 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:15.238022 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-1b499cec-855d-4be4-a634-6c066e927b96 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001707 Nov 24 15:13:15.238417 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 17/33] 10.222.0.66 () {54 vars in 930 bytes} [Wed Nov 24 15:13:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:15.306034 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-96faa831-5dcd-488c-b927-12fe4c2ab105 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "swap": 0, "ram": 16384}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:15.324636 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-96faa831-5dcd-488c-b927-12fe4c2ab105 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079654 Nov 24 15:13:15.325372 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 17/34] 10.222.0.66 () {64 vars in 1282 bytes} [Wed Nov 24 15:13:15 2021] POST /compute/v2.1/flavors => generated 408 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:13:15.338292 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-144b0423-a45c-4f4e-aff1-4024da35db82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:15.363328 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-144b0423-a45c-4f4e-aff1-4024da35db82 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029409 Nov 24 15:13:15.364315 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 18/35] 10.222.0.66 () {64 vars in 1332 bytes} [Wed Nov 24 15:13:15 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:13:36.682475 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-96faa831-5dcd-488c-b927-12fe4c2ab105 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:36.683527 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-96faa831-5dcd-488c-b927-12fe4c2ab105 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Nov 24 15:13:36.683930 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 18/36] 10.222.0.66 () {54 vars in 930 bytes} [Wed Nov 24 15:13:36 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:36.743138 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-14610999-be5e-4ef2-9510-5b1ffe77f51c admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:36.760063 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-14610999-be5e-4ef2-9510-5b1ffe77f51c admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069027 Nov 24 15:13:36.760603 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 19/37] 10.222.0.66 () {60 vars in 1291 bytes} [Wed Nov 24 15:13:36 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:13:38.239976 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-96faa831-5dcd-488c-b927-12fe4c2ab105 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:38.241621 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-96faa831-5dcd-488c-b927-12fe4c2ab105 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Nov 24 15:13:38.242048 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 19/38] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Nov 24 15:13:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:38.443107 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-4351bae3-05a4-498e-b85c-e5ac50d19a1a admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:38.448639 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.wsgi [None req-4351bae3-05a4-498e-b85c-e5ac50d19a1a admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 24 15:13:38.449129 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-4351bae3-05a4-498e-b85c-e5ac50d19a1a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:13:38.449914 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-4351bae3-05a4-498e-b85c-e5ac50d19a1a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057668 Nov 24 15:13:38.450421 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 20/39] 10.222.0.66 () {60 vars in 1190 bytes} [Wed Nov 24 15:13:38 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 15:13:38.459998 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-1e6fbc12-e363-42d6-871c-25d180de7cbc admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:38.480594 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-1e6fbc12-e363-42d6-871c-25d180de7cbc admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024073 Nov 24 15:13:38.481129 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 20/40] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Nov 24 15:13:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:13:38.492102 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-0c23964a-7dea-4cc2-9d0b-f0f02bc59bb3 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:38.512689 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-0c23964a-7dea-4cc2-9d0b-f0f02bc59bb3 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024627 Nov 24 15:13:38.513242 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 21/41] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Nov 24 15:13:38 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:13:38.523188 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-4d09160b-4e7c-4e0e-b0f4-0511b167e3b4 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:38.528655 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.wsgi [None req-4d09160b-4e7c-4e0e-b0f4-0511b167e3b4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 24 15:13:38.529210 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-4d09160b-4e7c-4e0e-b0f4-0511b167e3b4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:13:38.530121 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-4d09160b-4e7c-4e0e-b0f4-0511b167e3b4 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010466 Nov 24 15:13:38.530618 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 21/42] 10.222.0.66 () {60 vars in 1190 bytes} [Wed Nov 24 15:13:38 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 24 15:13:39.938756 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-0c23964a-7dea-4cc2-9d0b-f0f02bc59bb3 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:39.939799 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-0c23964a-7dea-4cc2-9d0b-f0f02bc59bb3 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Nov 24 15:13:39.940193 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 22/43] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Nov 24 15:13:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:40.132380 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-32e7dcd1-37a4-4084-baf9-4d67682859be admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:40.137989 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.wsgi [None req-32e7dcd1-37a4-4084-baf9-4d67682859be admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 24 15:13:40.138536 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-32e7dcd1-37a4-4084-baf9-4d67682859be admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:13:40.139348 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-32e7dcd1-37a4-4084-baf9-4d67682859be admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058649 Nov 24 15:13:40.139961 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 22/44] 10.222.0.66 () {60 vars in 1190 bytes} [Wed Nov 24 15:13:40 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 15:13:40.149992 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-0aaac626-ece4-4646-af4b-5f78c8871e6d admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:40.163248 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-0aaac626-ece4-4646-af4b-5f78c8871e6d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016872 Nov 24 15:13:40.163790 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 23/45] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Nov 24 15:13:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:13:40.173393 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-5dc23005-e122-4bee-9b3a-3d087361244b admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:40.187025 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-5dc23005-e122-4bee-9b3a-3d087361244b admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017083 Nov 24 15:13:40.187538 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 23/46] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Nov 24 15:13:40 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:13:40.197708 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-611daf09-9ed1-4f46-9653-b0c2681b8d81 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:40.202970 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.wsgi [None req-611daf09-9ed1-4f46-9653-b0c2681b8d81 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 24 15:13:40.203527 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-611daf09-9ed1-4f46-9653-b0c2681b8d81 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:13:40.204306 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-611daf09-9ed1-4f46-9653-b0c2681b8d81 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010612 Nov 24 15:13:40.204791 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 24/47] 10.222.0.66 () {60 vars in 1190 bytes} [Wed Nov 24 15:13:40 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 15:13:41.604394 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-5dc23005-e122-4bee-9b3a-3d087361244b admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:41.605420 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-5dc23005-e122-4bee-9b3a-3d087361244b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Nov 24 15:13:41.605850 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 24/48] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Nov 24 15:13:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:41.798002 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-0e3bb515-c8fd-4837-b326-fe7fcb3508ce admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:41.803628 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.wsgi [None req-0e3bb515-c8fd-4837-b326-fe7fcb3508ce admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 24 15:13:41.804477 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-0e3bb515-c8fd-4837-b326-fe7fcb3508ce admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101851) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:13:41.805281 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-0e3bb515-c8fd-4837-b326-fe7fcb3508ce admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060527 Nov 24 15:13:41.805817 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 25/49] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Nov 24 15:13:41 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 15:13:41.815651 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-cd734058-b93d-434f-bd38-be24a6d568d3 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:41.828999 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-cd734058-b93d-434f-bd38-be24a6d568d3 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016946 Nov 24 15:13:41.829551 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 25/50] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Nov 24 15:13:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:13:41.840851 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-94ddd6ac-e051-4e56-8c67-c86ea16b5b4b admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:41.854561 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-94ddd6ac-e051-4e56-8c67-c86ea16b5b4b admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017634 Nov 24 15:13:41.855159 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 26/51] 10.222.0.66 () {60 vars in 1210 bytes} [Wed Nov 24 15:13:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:13:41.865793 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-3051bbbf-77ff-4e70-ac5f-4a7e51940757 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:41.871676 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.wsgi [None req-3051bbbf-77ff-4e70-ac5f-4a7e51940757 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 24 15:13:41.872243 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-3051bbbf-77ff-4e70-ac5f-4a7e51940757 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:13:41.873041 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-3051bbbf-77ff-4e70-ac5f-4a7e51940757 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011106 Nov 24 15:13:41.873566 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 26/52] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Nov 24 15:13:41 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 24 15:13:43.260622 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-94ddd6ac-e051-4e56-8c67-c86ea16b5b4b admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:43.261660 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-94ddd6ac-e051-4e56-8c67-c86ea16b5b4b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Nov 24 15:13:43.262058 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 27/53] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Nov 24 15:13:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:43.457569 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-28131926-7b9d-4124-b45b-3381ba1a1c66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:43.476245 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-28131926-7b9d-4124-b45b-3381ba1a1c66 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069457 Nov 24 15:13:43.476753 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 27/54] 10.222.0.66 () {64 vars in 1235 bytes} [Wed Nov 24 15:13:43 2021] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:13:44.865979 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-94ddd6ac-e051-4e56-8c67-c86ea16b5b4b admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:44.867045 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-94ddd6ac-e051-4e56-8c67-c86ea16b5b4b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 Nov 24 15:13:44.867441 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 28/55] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Nov 24 15:13:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:45.057606 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-caa3a624-b05c-4c69-8727-523f6c11cf1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:45.078256 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-caa3a624-b05c-4c69-8727-523f6c11cf1d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.072622 Nov 24 15:13:45.078812 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 28/56] 10.222.0.66 () {64 vars in 1235 bytes} [Wed Nov 24 15:13:45 2021] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:13:46.459034 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-94ddd6ac-e051-4e56-8c67-c86ea16b5b4b admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:46.460073 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-94ddd6ac-e051-4e56-8c67-c86ea16b5b4b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Nov 24 15:13:46.460470 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 29/57] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Nov 24 15:13:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:46.652525 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-354b8671-4bbb-4472-8394-42e557430fc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:46.671506 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-354b8671-4bbb-4472-8394-42e557430fc6 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.071252 Nov 24 15:13:46.672036 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 29/58] 10.222.0.66 () {64 vars in 1235 bytes} [Wed Nov 24 15:13:46 2021] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:13:48.047790 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-94ddd6ac-e051-4e56-8c67-c86ea16b5b4b admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:48.048791 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-94ddd6ac-e051-4e56-8c67-c86ea16b5b4b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Nov 24 15:13:48.049192 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 30/59] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Nov 24 15:13:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:48.241803 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-8b5006e6-6865-4dec-87b4-b61d83e3e8a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:13:48.259753 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-8b5006e6-6865-4dec-87b4-b61d83e3e8a3 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.069423 Nov 24 15:13:48.260220 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 30/60] 10.222.0.66 () {64 vars in 1235 bytes} [Wed Nov 24 15:13:48 2021] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:13:49.638444 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-94ddd6ac-e051-4e56-8c67-c86ea16b5b4b admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:49.639617 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-94ddd6ac-e051-4e56-8c67-c86ea16b5b4b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001589 Nov 24 15:13:49.640023 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 31/61] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Nov 24 15:13:49 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:13:49.829946 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-f3ae972a-52ae-49b2-b1a2-b5d424958ad5 admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:13:49.849167 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-f3ae972a-52ae-49b2-b1a2-b5d424958ad5 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.069918 Nov 24 15:13:49.849636 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 31/62] 10.222.0.66 () {60 vars in 1202 bytes} [Wed Nov 24 15:13:49 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:14:35.784462 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-94ddd6ac-e051-4e56-8c67-c86ea16b5b4b admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:14:35.785511 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-94ddd6ac-e051-4e56-8c67-c86ea16b5b4b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Nov 24 15:14:35.785923 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 32/63] 10.222.0.66 () {54 vars in 930 bytes} [Wed Nov 24 15:14:35 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:14:35.844146 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-73714acd-a655-4461-bd4a-0e9e4407003d admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:14:35.863573 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-73714acd-a655-4461-bd4a-0e9e4407003d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070631 Nov 24 15:14:35.864191 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 32/64] 10.222.0.66 () {60 vars in 1291 bytes} [Wed Nov 24 15:14:35 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:14:35.889171 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-cab7acfb-a937-412d-9b17-3df813ed03b3 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:14:35.898352 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-cab7acfb-a937-412d-9b17-3df813ed03b3 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012750 Nov 24 15:14:35.898951 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 33/65] 10.222.0.66 () {60 vars in 1282 bytes} [Wed Nov 24 15:14:35 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:14:35.910438 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-dab301bf-2c95-4177-ac10-39721e8f330b admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:14:35.918506 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-dab301bf-2c95-4177-ac10-39721e8f330b admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011547 Nov 24 15:14:35.919059 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 33/66] 10.222.0.66 () {60 vars in 1285 bytes} [Wed Nov 24 15:14:35 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:14:35.930511 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-26ea61c7-ad83-4ab2-86ba-14c34ef61fc5 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:14:35.938159 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-26ea61c7-ad83-4ab2-86ba-14c34ef61fc5 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011044 Nov 24 15:14:35.938686 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 34/67] 10.222.0.66 () {60 vars in 1285 bytes} [Wed Nov 24 15:14:35 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:14:35.950597 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-a4507464-143c-46f4-b890-56c9e940cbec admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:14:35.958613 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-a4507464-143c-46f4-b890-56c9e940cbec admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010884 Nov 24 15:14:35.959318 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 34/68] 10.222.0.66 () {60 vars in 1282 bytes} [Wed Nov 24 15:14:35 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:16:04.008994 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-f08411ac-207a-49b9-9610-b53703fa11db tempest-verify_tempest_config-1705491259 tempest-verify_tempest_config-1705491259-project] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:16:04.010970 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-f08411ac-207a-49b9-9610-b53703fa11db tempest-verify_tempest_config-1705491259 tempest-verify_tempest_config-1705491259-project] 10.222.0.66 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105793 Nov 24 15:16:04.011502 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 35/69] 10.222.0.66 () {58 vars in 1133 bytes} [Wed Nov 24 15:16:03 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:17:33.044500 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-a4507464-143c-46f4-b890-56c9e940cbec admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:17:33.045297 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-a4507464-143c-46f4-b890-56c9e940cbec admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Nov 24 15:17:33.045698 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 35/70] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Nov 24 15:17:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:17:33.297878 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-a3cf2489-bdbc-405c-ae8f-18cfd9130ebe admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:17:33.299046 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:17:33.299046 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: warnings.warn(msg) Nov 24 15:17:33.300566 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-a3cf2489-bdbc-405c-ae8f-18cfd9130ebe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:17:33.300998 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-a3cf2489-bdbc-405c-ae8f-18cfd9130ebe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:17:33.301777 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-a3cf2489-bdbc-405c-ae8f-18cfd9130ebe admin admin] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:17:33.302197 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-a3cf2489-bdbc-405c-ae8f-18cfd9130ebe admin admin] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:17:33.334821 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-a3cf2489-bdbc-405c-ae8f-18cfd9130ebe admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.150344 Nov 24 15:17:33.335375 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 36/71] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Nov 24 15:17:33 2021] GET /compute/v2.1/os-services => generated 794 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:17:34.763010 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-a4507464-143c-46f4-b890-56c9e940cbec admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:17:34.764021 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-a4507464-143c-46f4-b890-56c9e940cbec admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Nov 24 15:17:34.764423 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 36/72] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Nov 24 15:17:34 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:17:34.961418 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-9609dd51-d59b-4dc3-9344-47260b2d470f admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:17:34.962562 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:17:34.962562 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: warnings.warn(msg) Nov 24 15:17:34.964165 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-9609dd51-d59b-4dc3-9344-47260b2d470f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:17:34.964598 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-9609dd51-d59b-4dc3-9344-47260b2d470f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:17:34.965382 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-9609dd51-d59b-4dc3-9344-47260b2d470f admin admin] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:17:34.965800 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-9609dd51-d59b-4dc3-9344-47260b2d470f admin admin] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:17:34.990862 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-9609dd51-d59b-4dc3-9344-47260b2d470f admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.080887 Nov 24 15:17:34.991417 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 37/73] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Nov 24 15:17:34 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:17:46.880615 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-a4507464-143c-46f4-b890-56c9e940cbec admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:17:46.881617 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-a4507464-143c-46f4-b890-56c9e940cbec admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Nov 24 15:17:46.882070 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 37/74] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Nov 24 15:17:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:17:47.073398 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-ac7b07cb-a01a-416e-b1a7-2d248e2b4cb9 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:17:47.074547 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:17:47.074547 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: warnings.warn(msg) Nov 24 15:17:47.076149 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-ac7b07cb-a01a-416e-b1a7-2d248e2b4cb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:17:47.076587 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-ac7b07cb-a01a-416e-b1a7-2d248e2b4cb9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:17:47.077408 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-ac7b07cb-a01a-416e-b1a7-2d248e2b4cb9 admin admin] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:17:47.077832 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-ac7b07cb-a01a-416e-b1a7-2d248e2b4cb9 admin admin] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:17:47.099212 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-ac7b07cb-a01a-416e-b1a7-2d248e2b4cb9 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.077020 Nov 24 15:17:47.099760 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 38/75] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Nov 24 15:17:47 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:17:48.509084 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: DEBUG nova.api.openstack.wsgi [None req-a4507464-143c-46f4-b890-56c9e940cbec admin admin] Calling method '>' {{(pid=101850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:17:48.510083 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: INFO nova.api.openstack.requestlog [None req-a4507464-143c-46f4-b890-56c9e940cbec admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Nov 24 15:17:48.510482 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: [pid: 101850|app: 0|req: 38/76] 10.222.0.66 () {56 vars in 1074 bytes} [Wed Nov 24 15:17:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:17:48.699928 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG nova.api.openstack.wsgi [None req-58f23eeb-c467-4064-896c-8491a32a6d92 admin admin] Calling method '>' {{(pid=101851) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:17:48.701076 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:17:48.701076 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: warnings.warn(msg) Nov 24 15:17:48.702581 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-58f23eeb-c467-4064-896c-8491a32a6d92 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:17:48.703064 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-58f23eeb-c467-4064-896c-8491a32a6d92 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:17:48.703860 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-58f23eeb-c467-4064-896c-8491a32a6d92 admin admin] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:17:48.704283 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: DEBUG oslo_concurrency.lockutils [None req-58f23eeb-c467-4064-896c-8491a32a6d92 admin admin] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101851) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:17:48.725769 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: INFO nova.api.openstack.requestlog [None req-58f23eeb-c467-4064-896c-8491a32a6d92 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.075957 Nov 24 15:17:48.726252 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: [pid: 101851|app: 0|req: 39/77] 10.222.0.66 () {60 vars in 1193 bytes} [Wed Nov 24 15:17:48 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:18:46.146394 dv-cinder-804035-20-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 24 15:18:46.147407 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: Wed Nov 24 15:18:46 2021 - graceful shutdown triggered... Nov 24 15:18:46.147851 dv-cinder-804035-20-iscsi devstack@n-api.service[101850]: Gracefully killing worker 1 (pid: 101850)... Nov 24 15:18:46.148401 dv-cinder-804035-20-iscsi devstack@n-api.service[101851]: Gracefully killing worker 2 (pid: 101851)... Nov 24 15:18:47.148401 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: worker 1 buried after 1 seconds Nov 24 15:18:47.148401 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: worker 2 buried after 1 seconds Nov 24 15:18:47.148401 dv-cinder-804035-20-iscsi devstack@n-api.service[101849]: goodbye to uWSGI. Nov 24 15:18:47.149888 dv-cinder-804035-20-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 24 15:18:47.150462 dv-cinder-804035-20-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 24 15:18:47.153264 dv-cinder-804035-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 24 15:18:47.166571 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 24 15:18:47.169294 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 24 15:18:47 2021] *** Nov 24 15:18:47.169294 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 24 15:18:47.169294 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 24 15:18:47.169294 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: nodename: dv-cinder-804035-20-iscsi Nov 24 15:18:47.169294 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: machine: x86_64 Nov 24 15:18:47.169294 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: clock source: unix Nov 24 15:18:47.169294 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: pcre jit disabled Nov 24 15:18:47.169294 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: detected number of CPU cores: 4 Nov 24 15:18:47.169294 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: current working directory: / Nov 24 15:18:47.169294 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: detected binary path: /usr/bin/uwsgi-core Nov 24 15:18:47.169294 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: your processes number limit is 47680 Nov 24 15:18:47.170110 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: your memory page size is 4096 bytes Nov 24 15:18:47.170110 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: detected max file descriptor number: 2048 Nov 24 15:18:47.170110 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: lock engine: pthread robust mutexes Nov 24 15:18:47.170110 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: thunder lock: enabled Nov 24 15:18:47.170110 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 24 15:18:47.170110 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 24 15:18:47.219111 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: Python main interpreter initialized at 0x55a0a4b259c0 Nov 24 15:18:47.219111 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: python threads support enabled Nov 24 15:18:47.219111 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: your server socket listen backlog is limited to 100 connections Nov 24 15:18:47.219111 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: your mercy for graceful operations on workers is 90 seconds Nov 24 15:18:47.219459 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: mapped 403077 bytes (393 KB) for 2 cores Nov 24 15:18:47.219608 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: *** Operational MODE: preforking *** Nov 24 15:18:47.219849 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: *** uWSGI is running in multiple interpreter mode *** Nov 24 15:18:47.219849 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: spawned uWSGI master process (pid: 116054) Nov 24 15:18:47.222336 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: spawned uWSGI worker 1 (pid: 116072, cores: 1) Nov 24 15:18:47.222336 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: spawned uWSGI worker 2 (pid: 116073, cores: 1) Nov 24 15:18:47.222336 dv-cinder-804035-20-iscsi devstack@n-api.service[116054]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 24 15:18:47.220051 dv-cinder-804035-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 24 15:18:48.984021 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 15:18:48.984021 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: from cryptography.utils import int_from_bytes Nov 24 15:18:48.984719 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 15:18:48.984719 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: from cryptography.utils import int_from_bytes Nov 24 15:18:48.992982 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 15:18:48.992982 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: from cryptography.utils import int_from_bytes Nov 24 15:18:48.993505 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 24 15:18:48.993505 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: from cryptography.utils import int_from_bytes Nov 24 15:18:51.326793 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 15:18:51.327686 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 15:18:51.327812 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 24 15:18:51.328190 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 24 15:18:51.328439 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 15:18:51.328804 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 15:18:51.328923 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 24 15:18:51.329087 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 15:18:51.329193 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 24 15:18:51.329442 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.329562 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 24 15:18:51.329768 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.329876 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.330090 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.330194 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.330408 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.330515 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.331312 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.331417 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.331708 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.332255 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.332342 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.332424 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.332503 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.332585 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.332661 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.332869 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.332974 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.333054 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.333225 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.333320 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.333524 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.333634 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-20-iscsi {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.333857 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-20-iscsi {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.333959 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.334184 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.334289 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.334498 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.334606 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.334900 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.334999 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.335156 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.335262 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.335462 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.335560 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.335770 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.335878 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.336084 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.336258 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.337804 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.338093 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.338351 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.338572 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.338779 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.339047 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.339258 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.339475 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.339685 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.339903 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.340120 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.340341 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.340562 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.340769 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.341002 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.341226 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.341434 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.341663 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.341886 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.342104 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.342311 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.342519 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-20-iscsi {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.342749 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-20-iscsi {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.342984 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.343162 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.343355 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.343546 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.343717 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.343907 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.344057 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.344210 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.344366 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.344523 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.344712 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.344866 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.345019 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.345165 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.345308 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.346004 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.346179 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.346350 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.346496 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.346639 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.346783 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.346978 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.347322 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.347476 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.347632 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.347784 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.347943 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.348098 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.348255 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.348412 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.348593 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.348769 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.348927 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.349072 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.349216 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.349360 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.349511 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.349511 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.349793 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.349793 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.350075 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.350224 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.350380 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.350524 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.350685 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.350893 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.351045 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.351045 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.351346 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.351504 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.351651 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.351651 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.351956 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.352102 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.352256 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.352408 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.352555 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.352555 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.352835 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.352835 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.353200 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.353355 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.353508 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.353660 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.353804 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.353965 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.354125 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.354271 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.354423 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.354574 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.354728 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.354916 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.355078 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.355231 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.355377 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.355548 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.356366 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.356529 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.356694 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.356841 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.356984 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.357135 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.357317 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.357317 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.357782 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.357782 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.358079 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.358234 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.358378 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.358538 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.358695 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.358898 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.359067 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.359219 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.359372 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.359537 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.359693 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.359837 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.359981 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.360132 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.360291 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.360291 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.360582 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.360582 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.360886 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.361044 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.361211 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.361211 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.361495 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.361647 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.361829 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.361978 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.362132 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.362276 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.362427 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.362579 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.362742 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.363493 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.363666 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.363820 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.363966 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.364370 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.364531 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.364687 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.365033 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.365379 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.365540 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.365698 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.365843 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.366511 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.366678 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.366932 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.367097 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.367244 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.367398 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.367570 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.367903 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.368056 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.368218 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.368379 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.368540 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.368694 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.368854 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.368998 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.369143 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.369287 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.369449 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.369594 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.369747 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.369900 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.370052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.370205 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.370365 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.370510 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.370775 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.370963 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.371111 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.371256 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.371415 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.371566 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.371720 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.371870 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.372023 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.372173 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.372331 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.372485 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.372630 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.372795 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.372941 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.373098 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.373243 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.373393 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.373546 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.373698 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.373849 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.374008 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.374153 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.374296 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.374438 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.374581 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.374746 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.374961 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.375121 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.375266 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.375418 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.375562 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.375720 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.375864 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.376009 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.376655 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.376821 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.376983 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.377209 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.378068 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.378236 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.378392 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.378546 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.378699 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.378882 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.379034 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.379187 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.379340 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.379486 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.379640 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.379796 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.379961 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.380106 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.380258 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.380403 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.380560 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.380706 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.380859 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.381013 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 24 15:18:51.381166 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.381312 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.381465 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.381610 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.381761 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.381925 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.382079 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.382240 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.382385 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.382530 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.382683 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.382879 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.383031 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.383190 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.383335 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.383527 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.383676 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.383831 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.384019 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.384179 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.384324 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.384468 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.384617 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.384762 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.384913 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.385067 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.385252 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.385408 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.385561 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.385714 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.385883 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.386042 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.386197 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.386915 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.386915 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.387206 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.387358 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.387515 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.387660 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.387813 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.387966 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.388317 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.388478 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.388657 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.388811 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.388964 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.389109 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.389254 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.389405 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.389559 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.389711 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.389856 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.390000 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.390144 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.390289 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.390463 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.390617 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.390761 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.390947 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.391095 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.391254 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.391407 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.391559 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.391712 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.391857 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.392000 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.392154 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.392339 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.392507 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.392663 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.392816 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.392995 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.393694 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.393858 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.394004 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.394149 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.394293 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.394443 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.394598 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.394755 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.394935 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.395105 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.395259 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.395413 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.395559 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.395708 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.395852 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.395995 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.396139 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.396296 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.396469 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.397125 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.397275 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.397419 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.397587 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.397754 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.397908 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.398061 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.398228 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.398559 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.398720 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.398941 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.399102 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.399249 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.399401 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.399553 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.399717 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.399874 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.400080 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.400239 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.400391 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.400545 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.400705 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.400857 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.401009 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.401154 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.401306 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.401459 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.401613 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.401777 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.401936 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.402088 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.402240 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.402385 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.402542 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.402688 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.402851 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.403014 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.403168 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.403328 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.403482 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.403628 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.403791 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.403945 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.404090 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.404248 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.404394 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.404538 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.404682 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.404825 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.404978 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.405132 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.405286 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.405438 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.405600 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.405746 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.405891 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.406122 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.406278 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.406472 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.406646 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.407315 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.407472 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.407635 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.407891 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.408050 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.408218 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.408394 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.408799 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.408962 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.409123 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.409285 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.409446 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.409599 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.409759 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.409911 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.410063 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.410216 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.410374 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.410526 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.410698 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.410883 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.411049 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.411202 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.411354 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.411505 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.411666 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.411819 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.411969 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.412120 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.412271 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.412437 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.412597 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.412768 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.412929 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.413088 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.413248 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.413410 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.413569 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.413720 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.413871 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.414030 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.414191 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.414357 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.414518 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.414670 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.414905 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.415065 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.415228 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.415391 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.415552 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.415703 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.415854 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.416011 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.416172 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.416331 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.416491 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.416650 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.416810 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.417628 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.417807 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.417970 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.418130 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.418308 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.418461 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.418622 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.419009 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.419172 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.419324 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.419474 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.419626 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.419795 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.419961 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.420122 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.420274 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.420432 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.420592 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.420758 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.420910 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.421067 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.421218 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.421369 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.421519 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.421690 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.421855 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.422006 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.422157 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.422306 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.422464 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.422625 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.422786 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.422974 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.423135 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.423287 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.423437 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.423600 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.423752 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.423918 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.424069 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.424241 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.424411 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.424598 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.424837 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.425017 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.425181 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.425333 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.425601 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.425780 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.425936 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.426094 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.426265 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.426417 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.426577 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.426737 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.426951 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.427326 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.427789 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.427958 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.428144 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.428492 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.428692 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.428848 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.429229 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.429518 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.429687 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.429840 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.429991 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.430143 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.430294 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.430460 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.430613 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.430763 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.430938 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.431090 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.431255 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.431429 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.431582 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.431732 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.431890 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.432042 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.432194 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.432356 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.432508 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.432667 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.432819 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.432978 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.433130 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.433291 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.433462 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.433615 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.433773 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.433924 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.434084 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.434237 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.434396 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.434559 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.434712 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.434905 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.435073 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.435233 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.435394 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.435556 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.435716 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.435867 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.436028 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.436180 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.436338 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.436498 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.436650 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.436809 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.436974 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.437126 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.437470 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.437931 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.438101 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.438349 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.438506 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.438666 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.438845 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.439004 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.439004 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.439609 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.439609 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.440489 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.440643 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.440803 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.440967 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.441129 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.441281 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.441431 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.441581 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.441740 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.441897 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.442058 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.442211 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.442361 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.442512 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.442670 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.442888 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.443070 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.443224 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.443384 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.443537 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.443695 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.443862 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.444023 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.444182 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.444342 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.444556 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.444710 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.444873 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.445026 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.445191 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.445342 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.445492 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.445644 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.445804 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.445966 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.446126 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.446286 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.446438 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.446597 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.446750 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.446954 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.447108 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.447269 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.447269 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.448137 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.448137 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.448462 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.448462 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.448750 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.448900 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.449067 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.449219 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.449407 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.449692 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.450018 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.450185 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.450353 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.450513 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.450729 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.450950 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.451106 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.451276 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.451436 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.451597 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.451758 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.451919 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.452073 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.452250 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.452410 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.452571 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.452723 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.452882 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.453034 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.453201 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.453354 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.453505 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.453656 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.453817 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.453976 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.454137 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.454318 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.454478 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.454639 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.454790 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.454977 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.455131 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.455297 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.455450 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.456162 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.456320 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.456518 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.456737 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.456906 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.457070 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.457222 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.457382 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.457681 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.457856 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.458310 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.458473 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.458634 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.458787 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.458965 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.459133 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.459287 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.459448 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.459601 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.459868 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.460231 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.460399 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.460561 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.460722 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.460922 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.461075 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.461236 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.461396 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.461548 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.461707 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.461878 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.462029 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.462189 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.462340 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.462491 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.462642 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.462888 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.463048 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.463209 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.463369 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.463674 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.463833 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.463985 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.464147 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.464312 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.464473 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.464624 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.464783 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.464935 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.465170 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.465340 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.465501 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.465699 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.465865 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.466026 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.466200 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.466361 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.466513 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.466673 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.466856 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.467025 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.467186 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.467337 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.467486 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.467783 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.467945 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.468124 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.468569 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.468740 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.468972 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.469126 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.469285 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.469447 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.469608 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.469761 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.470030 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.470374 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.470543 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.470769 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.470960 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.471142 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.471312 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.471474 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.471633 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.471800 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.471965 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.472126 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.472286 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.472446 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.472597 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.472759 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.472910 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.473062 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.473213 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.473373 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.473531 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.473697 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.473849 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.474010 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.474171 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.474331 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.474493 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.474725 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.474912 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.475067 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.475219 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.475370 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.475541 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.475694 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.475845 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.476004 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.476156 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.476324 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.476486 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.476646 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.476798 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.476948 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.477106 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.477267 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.477439 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.477604 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.477912 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.478081 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.478241 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.478695 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.478910 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.479069 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.479221 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.479371 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.479523 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.479684 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.479836 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.480025 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.480297 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.480623 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.480623 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.480933 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.481094 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.481251 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.481402 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.481563 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.481729 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.481881 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.482031 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.482188 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.482351 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.482351 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.482656 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.482831 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.483545 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.483709 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.483860 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.484012 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.484182 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.484344 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.484503 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.484665 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.484818 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.484986 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.485152 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.485306 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.485457 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.485608 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.485759 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.485917 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.486079 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.486239 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.486398 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.486550 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.486700 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.486918 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.487088 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.487241 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.487400 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.487560 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.487560 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.488880 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.489048 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.489458 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.489612 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.489763 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.489924 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.490087 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.490265 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.490553 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.490789 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.491044 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.491207 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.491207 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.491207 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.491768 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.491919 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.492071 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.492232 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.492232 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.492521 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.492692 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.492853 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.493014 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.493185 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.493338 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.493489 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.493649 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.493808 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.493961 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.494127 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.494280 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.494439 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.494591 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.494752 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.494940 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.495106 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.495259 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.495409 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.495566 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.495717 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.495717 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.496014 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.496166 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.496324 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.496482 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.496640 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.496815 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.496968 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.496968 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.497264 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.497417 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.497565 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.497731 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.497883 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.498188 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.498356 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.498517 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.498676 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.499147 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.499312 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.499471 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.499632 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.499791 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.499952 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.500159 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.500316 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.500469 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.500734 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.500976 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.501143 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.501297 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.501469 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.501641 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.501883 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.502049 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.502212 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.502911 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.503089 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.503242 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.503392 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.503551 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.503551 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.503551 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.503985 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.504147 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.504307 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.504541 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.504696 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.504854 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.505014 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.505167 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.505319 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.505484 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.505638 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.505796 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.505948 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.506110 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.506260 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.506421 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.506580 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.506732 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.506971 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.507125 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.507286 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.507450 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.507610 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.507771 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.507922 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.508081 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.508416 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.508577 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.508823 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.509272 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.509441 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.509595 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.509761 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.509915 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.510074 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.510235 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.510388 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.510539 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.510714 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.511020 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.511247 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.511404 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.511555 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.511705 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.511890 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.512191 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.513133 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.513305 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.513506 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.513669 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.513861 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.514038 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.514038 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.514349 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.514510 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.514665 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.514835 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.515004 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.515159 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.515317 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.515470 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.515620 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.515779 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.515945 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.516123 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.516283 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.516442 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.516594 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.516745 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.516905 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.517057 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.517217 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.517450 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.517608 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.517768 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.517934 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.518870 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.519058 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.519528 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.519690 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.519858 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.520011 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.520179 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.520332 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.520520 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.520684 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.520851 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.521025 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.521370 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.521542 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.521704 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.521857 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.522023 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.522193 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.522466 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.522624 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.522784 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.522962 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.523207 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.523373 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.523535 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.523851 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.524028 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.524198 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.524596 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.524750 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.524904 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.525056 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.525208 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.525376 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.525546 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.525913 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.526073 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.526227 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.526389 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.526635 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.526787 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.527011 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.527172 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.527317 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.527459 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.527612 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.527764 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.527912 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.528061 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.528211 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.528365 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.528365 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.528660 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.528818 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.529050 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.529207 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.529392 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.529709 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.529854 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.529998 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.530148 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.530299 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.530517 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.530667 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.530838 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.530979 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.531122 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.531297 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.531631 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.531786 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.531931 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.532073 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.532213 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.532369 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.532537 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.532679 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.532820 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.532983 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.533124 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.533279 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.533433 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.533598 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.533747 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.533896 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.534046 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.534197 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.534339 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.534479 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.534621 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.534762 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.534930 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.535087 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.535236 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.535384 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.535534 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.535683 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.535833 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.535983 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.536142 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.536293 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.536434 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.536537 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.536537 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.536537 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.536851 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.537118 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.537260 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.537410 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.537580 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.537754 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.537909 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.538078 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.538219 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.538371 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.538523 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.538688 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.538853 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.538853 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.539132 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.539280 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.539431 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.539578 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.539884 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.539994 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.540089 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.540192 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.540279 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.540371 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.540464 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.540549 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.540633 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.540734 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.540828 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.540920 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.541006 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.541006 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.541176 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.541263 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.541355 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.541506 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.541774 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.541877 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.541975 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.542061 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.542154 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.542247 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.542341 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.542426 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.542519 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.542613 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.542767 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.542883 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.542982 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.543079 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.543167 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.543251 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.543343 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.543428 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.543519 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.543613 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.543699 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.543790 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.543875 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.543965 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.543965 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.543965 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.544197 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.544280 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.544370 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.544463 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.544561 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.544654 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.544746 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.544830 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.544995 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.545091 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.545185 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.545279 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.545364 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.545462 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.545549 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.545654 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.545750 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.545843 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.545934 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.546019 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.546102 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.546199 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.546284 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.546380 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.546509 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.546586 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.546656 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.546754 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.546924 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.547015 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.547098 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.547263 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.547393 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.547507 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.547620 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.547732 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.547844 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.547964 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.548091 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.548247 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.548365 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.548487 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.548601 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.548728 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.548851 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.548964 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.549085 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.549715 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.550003 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.550207 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.550207 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.550436 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.550548 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.550658 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.550769 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.550919 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.551044 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.551156 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.551268 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.551377 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.551495 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.551622 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.551622 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.552036 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.552151 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.552262 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.552380 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.552502 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.552616 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.552728 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.552839 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.552957 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.553085 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.553199 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.553309 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.553419 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.553537 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.553657 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.553782 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.553905 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.554017 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.554144 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.554255 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.554365 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.554485 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.554617 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.554617 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.555024 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.555129 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.555217 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.555401 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.555401 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.555566 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.555659 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.555753 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.555851 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.555979 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.556117 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.556212 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.556296 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.556379 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.556472 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.556591 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.556728 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.556822 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.556914 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.557007 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.557102 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.557188 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.557279 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.557364 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.557447 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.557579 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.557718 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.557840 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.557942 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.558036 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.558130 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.558262 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.558398 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.558501 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.558595 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.558684 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.558775 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.558972 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.559098 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.559211 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.559331 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.559425 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.559544 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.559715 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.559811 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.559897 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.559996 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.560103 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.560176 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.560273 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.560360 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.560443 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.560533 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.560626 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.560725 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.560811 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.560903 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.560989 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.561074 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.561157 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.561250 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.561336 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.561419 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.561503 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.561503 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.561671 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.561765 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.561867 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.562127 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.562229 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.562325 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.562411 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.562505 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.562505 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.562670 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.562765 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.562902 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.563004 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.563092 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.563184 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.563270 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.563354 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.563445 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.563541 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.563626 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.563717 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.563812 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.563812 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.563973 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.564067 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.564153 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.564236 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.564327 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.564411 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.564411 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.564581 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.564711 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.564870 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.564989 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.565557 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.565645 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.565719 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.565790 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.565867 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.565939 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.566017 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.566098 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.566184 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.566276 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.566368 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.566468 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.566555 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.566651 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.566737 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.566846 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.566934 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.567017 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.567121 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.567210 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.567293 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.567385 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.567477 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.567570 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.567673 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.567760 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.567844 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.567928 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.568019 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.568105 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.568204 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.568298 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.568383 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.568474 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.568561 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.568663 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.568756 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.568894 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.569026 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.569115 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.569200 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.569297 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.569392 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.569484 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.569570 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.569570 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.569731 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.569892 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.569988 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.570074 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.570170 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.570306 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.570409 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.570503 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.570594 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.570686 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.570778 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.570778 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.571039 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.571127 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.571210 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.571302 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.571387 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.571471 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.571564 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.571658 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.571743 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.571833 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.571917 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.572076 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.572221 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.572314 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.572399 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.572482 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.572573 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.572673 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.572765 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.572857 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.572951 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.573036 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.573127 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.573226 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.573312 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.573403 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.573489 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.573572 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.573665 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.573760 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.573853 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.573938 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.574029 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.574121 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.574216 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.574302 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.574394 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.574487 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.574579 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.574664 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.574758 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.574868 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.575004 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.575132 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.575234 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.575320 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.575413 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.575506 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.575591 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.575674 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.575757 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.575899 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.576001 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.576147 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.576267 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.576359 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.576452 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.576548 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.576642 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.576739 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.576884 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.577015 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.577103 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.577198 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.577284 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.577368 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.577453 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.577544 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.577636 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.577731 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.577823 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.577915 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.578000 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.578092 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.578190 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.578283 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.578375 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.578468 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.578600 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.578746 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.578891 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.579011 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.579124 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.579243 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.579356 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.579486 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.579590 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.579677 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.579761 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.579892 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.579975 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.580065 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.580138 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.580208 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.580277 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.580347 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116072) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 15:18:51.580424 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.580424 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.580424 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.580424 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.580424 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.580424 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.580424 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.580424 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.581048 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.581048 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.581227 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.581557 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.581884 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.582219 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 24 15:18:51.582447 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116073) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 24 15:18:51.599066 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_db.sqlalchemy.engines [None req-8a129826-5fd3-4ef0-af64-b9dc6beec917 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:18:51.605234 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_db.sqlalchemy.engines [None req-dd4a3bd3-0a62-4a9b-a2e9-e89cc8a954a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:18:51.759635 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.context [None req-8a129826-5fd3-4ef0-af64-b9dc6beec917 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),394dac41-edff-43f6-a3ed-5e4ac19075b2(cell1) {{(pid=116072) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 15:18:51.764243 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a129826-5fd3-4ef0-af64-b9dc6beec917 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:18:51.765714 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.context [None req-dd4a3bd3-0a62-4a9b-a2e9-e89cc8a954a6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),394dac41-edff-43f6-a3ed-5e4ac19075b2(cell1) {{(pid=116073) load_cells /opt/stack/nova/nova/context.py:464}} Nov 24 15:18:51.765849 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a129826-5fd3-4ef0-af64-b9dc6beec917 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:18:51.766617 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a129826-5fd3-4ef0-af64-b9dc6beec917 None None] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:18:51.768643 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a129826-5fd3-4ef0-af64-b9dc6beec917 None None] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:18:51.770160 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dd4a3bd3-0a62-4a9b-a2e9-e89cc8a954a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:18:51.772065 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dd4a3bd3-0a62-4a9b-a2e9-e89cc8a954a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:18:51.772741 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dd4a3bd3-0a62-4a9b-a2e9-e89cc8a954a6 None None] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:18:51.774706 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dd4a3bd3-0a62-4a9b-a2e9-e89cc8a954a6 None None] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:18:51.780278 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_db.sqlalchemy.engines [None req-8a129826-5fd3-4ef0-af64-b9dc6beec917 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:18:51.782119 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_db.sqlalchemy.engines [None req-8a129826-5fd3-4ef0-af64-b9dc6beec917 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:18:51.785530 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_db.sqlalchemy.engines [None req-dd4a3bd3-0a62-4a9b-a2e9-e89cc8a954a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:18:51.795055 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_db.sqlalchemy.engines [None req-dd4a3bd3-0a62-4a9b-a2e9-e89cc8a954a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:18:51.953540 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_db.sqlalchemy.engines [None req-8a129826-5fd3-4ef0-af64-b9dc6beec917 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116072) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:18:51.958568 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_db.sqlalchemy.engines [None req-dd4a3bd3-0a62-4a9b-a2e9-e89cc8a954a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116073) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 24 15:18:52.274861 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: WARNING keystonemiddleware.auth_token [None req-8a129826-5fd3-4ef0-af64-b9dc6beec917 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 15:18:52.280641 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: WARNING keystonemiddleware.auth_token [None req-dd4a3bd3-0a62-4a9b-a2e9-e89cc8a954a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 15:18:52.281364 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: WARNING keystonemiddleware.auth_token [None req-8a129826-5fd3-4ef0-af64-b9dc6beec917 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 15:18:52.287709 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: WARNING keystonemiddleware.auth_token [None req-dd4a3bd3-0a62-4a9b-a2e9-e89cc8a954a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 15:18:52.624857 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: WARNING keystonemiddleware.auth_token [None req-8a129826-5fd3-4ef0-af64-b9dc6beec917 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 15:18:52.630653 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: WARNING keystonemiddleware.auth_token [None req-8a129826-5fd3-4ef0-af64-b9dc6beec917 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 15:18:52.631203 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: WARNING keystonemiddleware.auth_token [None req-dd4a3bd3-0a62-4a9b-a2e9-e89cc8a954a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 24 15:18:52.636037 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a0a4b259c0 pid: 116072 (default app) Nov 24 15:18:52.636468 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: WARNING keystonemiddleware.auth_token [None req-dd4a3bd3-0a62-4a9b-a2e9-e89cc8a954a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 24 15:18:52.641819 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a0a4b259c0 pid: 116073 (default app) Nov 24 15:19:25.758329 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-757745f8-6eaa-4724-8175-a04e6bb6327a tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] Action: 'create', calling method: .version_select at 0x7f930eaef550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-197567362", "metadata": {"Type": "work"}}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:19:25.760139 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-757745f8-6eaa-4724-8175-a04e6bb6327a tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:19:25.761120 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-757745f8-6eaa-4724-8175-a04e6bb6327a tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.228796 Nov 24 15:19:25.761587 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 1/1] 10.222.0.66 () {60 vars in 1155 bytes} [Wed Nov 24 15:19:24 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 24 15:19:25.993410 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b8c72b42-6497-4db9-9a52-78d5a132008e tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] Action: 'create', calling method: .version_select at 0x7f930eb35160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1818563315", "metadata": {"Type": "work"}}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:19:25.995112 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b8c72b42-6497-4db9-9a52-78d5a132008e tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:19:25.996025 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b8c72b42-6497-4db9-9a52-78d5a132008e tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.227837 Nov 24 15:19:25.997076 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 1/2] 10.222.0.66 () {60 vars in 1155 bytes} [Wed Nov 24 15:19:25 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 230 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 24 15:19:26.006463 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-220890fb-1dba-47b2-a787-1cfa7a19687b tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] Action: 'create', calling method: .version_select at 0x7f930e9fa160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-370494027", "metadata": {"Type": "work"}}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:19:26.007287 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-220890fb-1dba-47b2-a787-1cfa7a19687b tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:19:26.009371 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-220890fb-1dba-47b2-a787-1cfa7a19687b tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006916 Nov 24 15:19:26.010398 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 2/3] 10.222.0.66 () {60 vars in 1155 bytes} [Wed Nov 24 15:19:26 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 24 15:19:26.020380 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-eb7851d3-fb0c-4043-859b-20e02a2be931 tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] Calling method '.version_select at 0x7f930eaefd30>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:26.794801 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b33c0d46-def8-46e9-9f97-3ff17f2aea57 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Action: 'create', calling method: .version_select at 0x7f930f30ea60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-612162806"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:19:27.139619 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-eb7851d3-fb0c-4043-859b-20e02a2be931 tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] HTTP exception thrown: Volume tempest-invalid-572195047 could not be found. Nov 24 15:19:27.140369 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-eb7851d3-fb0c-4043-859b-20e02a2be931 tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] Returning 404 to user: Volume tempest-invalid-572195047 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:19:27.141495 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-eb7851d3-fb0c-4043-859b-20e02a2be931 tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-572195047" status: 404 len: 98 microversion: 2.1 time: 1.125155 Nov 24 15:19:27.143344 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 3/4] 10.222.0.66 () {58 vars in 1214 bytes} [Wed Nov 24 15:19:26 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-572195047 => generated 98 bytes in 1127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 24 15:19:27.424460 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-837bc549-a7bc-43a0-a1a5-bceb849c1661 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] Action: 'create', calling method: .version_select at 0x7f930e9be670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1456019291", "metadata": {"Type": "work"}}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:19:28.182659 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b33c0d46-def8-46e9-9f97-3ff17f2aea57 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.169390 Nov 24 15:19:28.184271 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 2/5] 10.222.0.66 () {60 vars in 1154 bytes} [Wed Nov 24 15:19:26 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 2172 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 24 15:19:28.190226 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2fc021b0-c56e-46e6-a6e0-36ade223183a tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004456 Nov 24 15:19:28.190664 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 3/6] 10.222.0.66 () {58 vars in 1139 bytes} [Wed Nov 24 15:19:28 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 24 15:19:28.423673 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-837bc549-a7bc-43a0-a1a5-bceb849c1661 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.278438 Nov 24 15:19:28.425069 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 4/7] 10.222.0.66 () {60 vars in 1155 bytes} [Wed Nov 24 15:19:27 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 1281 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 24 15:19:28.430940 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-249b3f18-4b5f-45c9-bba1-b700a623d482 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930e9beca0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:28.491803 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-249b3f18-4b5f-45c9-bba1-b700a623d482 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/a94bfb65-4fd0-49db-beaa-c007f713f643" status: 200 len: 344 microversion: 2.1 time: 0.065360 Nov 24 15:19:28.492751 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 5/8] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:19:28 2021] GET /compute/v2.1/os-volumes/a94bfb65-4fd0-49db-beaa-c007f713f643 => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:28.497654 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6bb2e9ff-0337-4403-9492-4801eef4e26a tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003559 Nov 24 15:19:28.498450 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 6/9] 10.222.0.66 () {58 vars in 1136 bytes} [Wed Nov 24 15:19:28 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 24 15:19:28.503646 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a99c3a88-7f49-4c33-8be8-3ea7beb2e7e8 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] Calling method '.version_select at 0x7f930e9535e0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:28.533529 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1547001607", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452", "networks": [{"uuid": "70c457e2-22ff-4a59-b8ba-a00e5e3e2e37"}]}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:19:28.562654 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a99c3a88-7f49-4c33-8be8-3ea7beb2e7e8 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd" status: 200 len: 353 microversion: 2.1 time: 0.063035 Nov 24 15:19:28.563291 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 7/10] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:19:28 2021] GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:28.568563 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-07340da1-f3b8-4ff5-a499-80f8abb6e815 tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] Calling method '.version_select at 0x7f930e953ee0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:28.617537 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-07340da1-f3b8-4ff5-a499-80f8abb6e815 tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] HTTP exception thrown: Volume f272ab8e-e0cb-47af-a1a3-f0177f6295e0 could not be found. Nov 24 15:19:28.618122 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-07340da1-f3b8-4ff5-a499-80f8abb6e815 tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] Returning 404 to user: Volume f272ab8e-e0cb-47af-a1a3-f0177f6295e0 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:19:28.619185 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-07340da1-f3b8-4ff5-a499-80f8abb6e815 tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/f272ab8e-e0cb-47af-a1a3-f0177f6295e0" status: 404 len: 109 microversion: 2.1 time: 0.054244 Nov 24 15:19:28.620289 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 8/11] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Nov 24 15:19:28 2021] DELETE /compute/v2.1/os-volumes/f272ab8e-e0cb-47af-a1a3-f0177f6295e0 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:19:28.642511 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-199b3bbe-580c-4824-bf8a-b7eb1cf42a23 tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] Calling method '.version_select at 0x7f930e9538b0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:28.703603 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-199b3bbe-580c-4824-bf8a-b7eb1cf42a23 tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] HTTP exception thrown: Volume 4cb3a8e1-c771-474d-98b6-830380019175 could not be found. Nov 24 15:19:28.704460 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-199b3bbe-580c-4824-bf8a-b7eb1cf42a23 tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] Returning 404 to user: Volume 4cb3a8e1-c771-474d-98b6-830380019175 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:19:28.705690 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-199b3bbe-580c-4824-bf8a-b7eb1cf42a23 tempest-VolumesNegativeTest-890260740 tempest-VolumesNegativeTest-890260740-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/4cb3a8e1-c771-474d-98b6-830380019175" status: 404 len: 109 microversion: 2.1 time: 0.080431 Nov 24 15:19:28.706757 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 9/12] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:19:28 2021] GET /compute/v2.1/os-volumes/4cb3a8e1-c771-474d-98b6-830380019175 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:19:28.752535 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.network.neutron [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] validate_networks() for [('70c457e2-22ff-4a59-b8ba-a00e5e3e2e37', None, None, None, None, None)] {{(pid=116073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:19:29.505080 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7e01db61-24e8-4342-b467-577efc8fec88 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930ea18dc0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:29.604009 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7e01db61-24e8-4342-b467-577efc8fec88 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/a94bfb65-4fd0-49db-beaa-c007f713f643" status: 200 len: 345 microversion: 2.1 time: 0.103428 Nov 24 15:19:29.613153 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 10/13] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:19:29 2021] GET /compute/v2.1/os-volumes/a94bfb65-4fd0-49db-beaa-c007f713f643 => generated 345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:29.625300 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f4d6f1d8-6e49-468c-af2b-18d12e83a8e6 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] Calling method '.version_select at 0x7f930e953700>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:29.709339 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f4d6f1d8-6e49-468c-af2b-18d12e83a8e6 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd" status: 200 len: 354 microversion: 2.1 time: 0.093384 Nov 24 15:19:29.710757 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 11/14] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:19:29 2021] GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:29.716001 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-74ac56b6-0516-425d-9c22-edd73182901b tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Action: 'create', calling method: .version_select at 0x7f930e9bedc0>, body: {"snapshot": {"volume_id": "a94bfb65-4fd0-49db-beaa-c007f713f643", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-370884798"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:19:29.968642 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-74ac56b6-0516-425d-9c22-edd73182901b tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.256508 Nov 24 15:19:29.969465 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 12/15] 10.222.0.66 () {60 vars in 1161 bytes} [Wed Nov 24 15:19:29 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:29.975672 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c71583b0-ac61-4240-8885-9e0e57cad7be tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] Calling method '.version_select at 0x7f930e9611f0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:30.043165 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c71583b0-ac61-4240-8885-9e0e57cad7be tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd" status: 200 len: 354 microversion: 2.1 time: 0.071794 Nov 24 15:19:30.056776 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 13/16] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:19:29 2021] GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:30.061380 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-faef5b1b-b5e5-442a-b597-dd8215de7827 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930e9beee0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:30.093454 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-faef5b1b-b5e5-442a-b597-dd8215de7827 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921" status: 200 len: 286 microversion: 2.1 time: 0.048588 Nov 24 15:19:30.094025 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 14/17] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Nov 24 15:19:30 2021] GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:30.098880 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2b34dc2b-d8e0-44d3-afbb-56dfb98bc116 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] Calling method '.version_select at 0x7f930e9be280>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:30.195867 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2b34dc2b-d8e0-44d3-afbb-56dfb98bc116 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd" status: 202 len: 0 microversion: 2.1 time: 0.100751 Nov 24 15:19:30.200683 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 15/18] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Nov 24 15:19:30 2021] DELETE /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:19:30.203641 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-619b076f-b00d-45b6-8132-122908fb6ccf tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930e9533a0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:30.253502 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-619b076f-b00d-45b6-8132-122908fb6ccf tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.055387 Nov 24 15:19:30.254763 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 16/19] 10.222.0.66 () {58 vars in 1139 bytes} [Wed Nov 24 15:19:30 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:30.259534 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f950860d-3d2a-4364-9f3a-b5e8e574a059 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] Calling method '.version_select at 0x7f930e9be430>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:30.310639 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f950860d-3d2a-4364-9f3a-b5e8e574a059 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd" status: 200 len: 353 microversion: 2.1 time: 0.054508 Nov 24 15:19:30.311235 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 17/20] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:19:30 2021] GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:30.316268 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-91c133e1-037b-4f6f-9f1a-4350f33a557a tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930e9beee0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:30.334469 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Flavor limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:19:30.335595 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Image limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:19:30.336299 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Flavor pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:19:30.336919 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Image pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:19:30.337552 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:19:30.347643 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-91c133e1-037b-4f6f-9f1a-4350f33a557a tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921" status: 200 len: 286 microversion: 2.1 time: 0.035137 Nov 24 15:19:30.351629 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 18/21] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Nov 24 15:19:30 2021] GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:30.356547 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:30.357225 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:30.358370 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:30.359062 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:30.393374 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Getting quotas for project e68438dfae03483f8491309dfb3fbcfe. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:19:30.401501 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Getting quotas for user 965237762c1c4340917cb5ddf344ca17 and project e68438dfae03483f8491309dfb3fbcfe. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:19:30.418003 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Going to run 1 instances... {{(pid=116073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:19:30.422719 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:19:30.537555 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-04e91cc2-6afa-46f6-92eb-97ab2f22a0e7 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.341300 Nov 24 15:19:30.541589 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 4/22] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:19:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 2348 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:19:30.564797 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8a3da446-aeee-477a-93f1-60389becffa6 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:30.565557 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8a3da446-aeee-477a-93f1-60389becffa6 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:30.765286 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8a3da446-aeee-477a-93f1-60389becffa6 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:30.808573 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8a3da446-aeee-477a-93f1-60389becffa6 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1215 microversion: 2.1 time: 0.258309 Nov 24 15:19:30.820430 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 19/23] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:30 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1215 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:31.326630 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-48eb6137-33a1-4a50-aeb1-29bb309688be tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] Calling method '.version_select at 0x7f930e0438b0>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:31.360619 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6dec553f-350e-4b83-b2cd-8cc7dc68e410 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930e9bee50>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:31.511906 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-48eb6137-33a1-4a50-aeb1-29bb309688be tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd" status: 200 len: 353 microversion: 2.1 time: 0.191164 Nov 24 15:19:31.512637 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 5/24] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:19:31 2021] GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd => generated 353 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:31.600423 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6dec553f-350e-4b83-b2cd-8cc7dc68e410 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921" status: 200 len: 286 microversion: 2.1 time: 0.244863 Nov 24 15:19:31.601282 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 20/25] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Nov 24 15:19:31 2021] GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921 => generated 286 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:31.826985 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-525d4693-52c2-47c4-9175-48280b0e079e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:31.827598 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-525d4693-52c2-47c4-9175-48280b0e079e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:31.957612 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-525d4693-52c2-47c4-9175-48280b0e079e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:31.997110 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-525d4693-52c2-47c4-9175-48280b0e079e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1215 microversion: 2.1 time: 0.173770 Nov 24 15:19:32.001623 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 6/26] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:31 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1215 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:32.524186 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-99d066c9-f809-4bd5-9f2a-dfaedbf8574f tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] Calling method '.version_select at 0x7f930e91c280>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:32.611808 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-99d066c9-f809-4bd5-9f2a-dfaedbf8574f tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd" status: 200 len: 353 microversion: 2.1 time: 0.091442 Nov 24 15:19:32.612990 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-41ea97aa-b7b6-4b10-91aa-0f4a242a298a tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930e074310>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:32.617214 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 21/27] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:19:32 2021] GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:32.650587 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-41ea97aa-b7b6-4b10-91aa-0f4a242a298a tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921" status: 200 len: 286 microversion: 2.1 time: 0.042226 Nov 24 15:19:32.651489 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 7/28] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Nov 24 15:19:32 2021] GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:19:33.017811 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-92525603-48ae-424b-b7ed-1a56fcfb6389 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:33.025301 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-92525603-48ae-424b-b7ed-1a56fcfb6389 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:33.036741 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-92525603-48ae-424b-b7ed-1a56fcfb6389 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:33.039373 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-92525603-48ae-424b-b7ed-1a56fcfb6389 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:33.041429 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-92525603-48ae-424b-b7ed-1a56fcfb6389 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:33.042259 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-92525603-48ae-424b-b7ed-1a56fcfb6389 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:33.438927 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-92525603-48ae-424b-b7ed-1a56fcfb6389 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:33.463433 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-92525603-48ae-424b-b7ed-1a56fcfb6389 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1219 microversion: 2.1 time: 0.449054 Nov 24 15:19:33.466251 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 22/29] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:33 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1219 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:33.624452 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f4d065d3-6718-476d-ad96-dc7bc80df33e tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] Calling method '.version_select at 0x7f930d803550>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:33.661272 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a5ce58de-b294-4a6a-bcf0-12b87593cf7f tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930e88da60>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:33.716158 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a5ce58de-b294-4a6a-bcf0-12b87593cf7f tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921" status: 200 len: 287 microversion: 2.1 time: 0.058531 Nov 24 15:19:33.716806 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 23/30] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Nov 24 15:19:33 2021] GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921 => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:19:33.727145 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2270b63f-6735-4cc1-a933-48d516f34cc7 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930e8985e0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:33.745003 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f4d065d3-6718-476d-ad96-dc7bc80df33e tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd" status: 200 len: 353 microversion: 2.1 time: 0.124342 Nov 24 15:19:33.750364 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 8/31] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:19:33 2021] GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:33.857566 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2270b63f-6735-4cc1-a933-48d516f34cc7 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921" status: 202 len: 0 microversion: 2.1 time: 0.133950 Nov 24 15:19:33.858375 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 24/32] 10.222.0.66 () {58 vars in 1253 bytes} [Wed Nov 24 15:19:33 2021] DELETE /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 15:19:33.868185 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8bad6b0e-3942-4dfe-9b58-1cef01e74528 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930e074280>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:33.925512 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8bad6b0e-3942-4dfe-9b58-1cef01e74528 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921" status: 200 len: 286 microversion: 2.1 time: 0.061236 Nov 24 15:19:33.926143 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 9/33] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Nov 24 15:19:33 2021] GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:34.507688 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-68443742-45f2-40b2-abeb-03b2ee4a06da tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:34.508411 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-68443742-45f2-40b2-abeb-03b2ee4a06da tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:34.518477 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68443742-45f2-40b2-abeb-03b2ee4a06da tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:34.518973 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68443742-45f2-40b2-abeb-03b2ee4a06da tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:34.519782 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68443742-45f2-40b2-abeb-03b2ee4a06da tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:34.520214 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68443742-45f2-40b2-abeb-03b2ee4a06da tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:34.691373 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-68443742-45f2-40b2-abeb-03b2ee4a06da tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:34.704930 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-68443742-45f2-40b2-abeb-03b2ee4a06da tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1267 microversion: 2.1 time: 0.222813 Nov 24 15:19:34.714795 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 25/34] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:34 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:34.759191 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a1dffbe6-4d5d-44bd-9773-e99171b3145d tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] Calling method '.version_select at 0x7f930d803700>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:34.888997 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a1dffbe6-4d5d-44bd-9773-e99171b3145d tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd" status: 200 len: 353 microversion: 2.1 time: 0.134394 Nov 24 15:19:34.895437 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 10/35] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:19:34 2021] GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:34.937550 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c0daddc5-7cfe-4ea8-8556-3e1b725476a9 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930e8b00d0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:35.015955 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c0daddc5-7cfe-4ea8-8556-3e1b725476a9 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921" status: 200 len: 286 microversion: 2.1 time: 0.082668 Nov 24 15:19:35.017273 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 26/36] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Nov 24 15:19:34 2021] GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:35.742891 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1464387817", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b8e34ef-bafa-4e65-a88d-1be4877982c1"}]}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:19:35.830679 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.network.neutron [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] validate_networks() for [('8b8e34ef-bafa-4e65-a88d-1be4877982c1', None, None, None, None, None)] {{(pid=116073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:19:35.831860 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9e473344-1915-4c24-99aa-6ed1a18f09b7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'create', calling method: .version_select at 0x7f930e9bea60>, body: {"keypair": {"name": "tempest-keypair-482992359"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:19:35.884654 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-9e473344-1915-4c24-99aa-6ed1a18f09b7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Getting quotas for project cebad9fcbd0d4232a6f6dccb42ba04a1. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:19:35.892445 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-9e473344-1915-4c24-99aa-6ed1a18f09b7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Getting quotas for user a43cdd892899464190fa5a6cfc411ad0 and project cebad9fcbd0d4232a6f6dccb42ba04a1. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:19:36.267245 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-9e473344-1915-4c24-99aa-6ed1a18f09b7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Getting quotas for project cebad9fcbd0d4232a6f6dccb42ba04a1. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:19:36.271055 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-9e473344-1915-4c24-99aa-6ed1a18f09b7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Getting quotas for user a43cdd892899464190fa5a6cfc411ad0 and project cebad9fcbd0d4232a6f6dccb42ba04a1. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:19:36.284618 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9e473344-1915-4c24-99aa-6ed1a18f09b7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.768797 Nov 24 15:19:36.285342 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 27/37] 10.222.0.66 () {60 vars in 1157 bytes} [Wed Nov 24 15:19:35 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:19:36.291726 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-62a822ff-597c-4ee1-8cf5-d379327b984c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:36.292224 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-62a822ff-597c-4ee1-8cf5-d379327b984c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:36.300150 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-62a822ff-597c-4ee1-8cf5-d379327b984c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:36.300956 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-62a822ff-597c-4ee1-8cf5-d379327b984c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:36.301581 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-62a822ff-597c-4ee1-8cf5-d379327b984c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:36.302397 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-62a822ff-597c-4ee1-8cf5-d379327b984c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:36.399608 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-62a822ff-597c-4ee1-8cf5-d379327b984c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:36.408051 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-62a822ff-597c-4ee1-8cf5-d379327b984c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1267 microversion: 2.1 time: 0.118960 Nov 24 15:19:36.408168 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 28/38] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:36 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1267 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:36.420693 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-eb96b0c8-cbed-4dd0-81dd-2f0cff2a01d7 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] Calling method '.version_select at 0x7f930e953a60>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:36.466479 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Flavor limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:19:36.467146 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Image limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:19:36.467734 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Flavor pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:19:36.468279 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Image pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:19:36.469162 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:19:36.484012 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:36.484949 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-eb96b0c8-cbed-4dd0-81dd-2f0cff2a01d7 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd" status: 200 len: 353 microversion: 2.1 time: 0.075757 Nov 24 15:19:36.486106 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:36.491426 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 29/39] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:19:36 2021] GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd => generated 353 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:36.491853 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:36.491853 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:36.501974 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1dc10bf6-007e-426f-b86f-709e9a3f8f59 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930e834a60>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:36.517507 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Getting quotas for project 32404aa4e2d44b9e966da2bab0b27149. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:19:36.525064 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Getting quotas for user ede07ca84abc4ee6947d36c55591c84d and project 32404aa4e2d44b9e966da2bab0b27149. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:19:36.540012 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Going to run 1 instances... {{(pid=116073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:19:36.542278 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:19:36.605970 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1dc10bf6-007e-426f-b86f-709e9a3f8f59 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921" status: 200 len: 286 microversion: 2.1 time: 0.117699 Nov 24 15:19:36.611706 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 30/40] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Nov 24 15:19:36 2021] GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921 => generated 286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:36.616805 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-fbfc868a-26f5-4b18-81d6-96d919744777 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.196286 Nov 24 15:19:36.623440 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 11/41] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:19:35 2021] POST /compute/v2.1/servers => generated 383 bytes in 1203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:19:36.631934 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-82cc143a-8916-486a-8eb1-ac798cdc687d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:36.632837 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-82cc143a-8916-486a-8eb1-ac798cdc687d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:36.734742 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-82cc143a-8916-486a-8eb1-ac798cdc687d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:36.748983 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-82cc143a-8916-486a-8eb1-ac798cdc687d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1222 microversion: 2.1 time: 0.120979 Nov 24 15:19:36.750494 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 31/42] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:36 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1222 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:36.947631 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1010157854", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b8e34ef-bafa-4e65-a88d-1be4877982c1"}]}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:19:37.065957 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.network.neutron [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] validate_networks() for [('8b8e34ef-bafa-4e65-a88d-1be4877982c1', None, None, None, None, None)] {{(pid=116073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:19:37.425210 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4aebec33-72d0-4ea7-80ae-46f4cacd1a29 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:37.425850 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4aebec33-72d0-4ea7-80ae-46f4cacd1a29 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:37.444312 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4aebec33-72d0-4ea7-80ae-46f4cacd1a29 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:37.446700 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4aebec33-72d0-4ea7-80ae-46f4cacd1a29 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:37.452788 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4aebec33-72d0-4ea7-80ae-46f4cacd1a29 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:37.453640 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4aebec33-72d0-4ea7-80ae-46f4cacd1a29 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:37.732573 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4aebec33-72d0-4ea7-80ae-46f4cacd1a29 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:37.745022 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4aebec33-72d0-4ea7-80ae-46f4cacd1a29 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1285 microversion: 2.1 time: 0.324071 Nov 24 15:19:37.751180 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 32/43] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:37 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1285 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:19:37.778191 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-89880123-7b3f-4173-9428-e7951ab94ae3 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] Calling method '.version_select at 0x7f930dfe9c10>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:38.064339 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-89880123-7b3f-4173-9428-e7951ab94ae3 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] HTTP exception thrown: Volume e4544f8b-58c0-4258-9f32-6445ee99aecd could not be found. Nov 24 15:19:38.065414 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-89880123-7b3f-4173-9428-e7951ab94ae3 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] Returning 404 to user: Volume e4544f8b-58c0-4258-9f32-6445ee99aecd could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:19:38.067053 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-89880123-7b3f-4173-9428-e7951ab94ae3 tempest-VolumesGetTestJSON-1229337969 tempest-VolumesGetTestJSON-1229337969-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd" status: 404 len: 109 microversion: 2.1 time: 0.314252 Nov 24 15:19:38.068216 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 33/44] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:19:37 2021] GET /compute/v2.1/os-volumes/e4544f8b-58c0-4258-9f32-6445ee99aecd => generated 109 bytes in 316 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:19:38.076142 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5f341060-ab58-432e-8572-1f83e663cd15 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930dff4310>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:38.126105 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Flavor limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:19:38.129729 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-5f341060-ab58-432e-8572-1f83e663cd15 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] HTTP exception thrown: Snapshot 442ea50a-b406-4a03-b42e-62f70bc22921 could not be found. Nov 24 15:19:38.131596 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5f341060-ab58-432e-8572-1f83e663cd15 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Returning 404 to user: Snapshot 442ea50a-b406-4a03-b42e-62f70bc22921 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:19:38.132826 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5f341060-ab58-432e-8572-1f83e663cd15 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921" status: 404 len: 111 microversion: 2.1 time: 0.063302 Nov 24 15:19:38.133562 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Image limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:19:38.134208 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Flavor pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:19:38.136083 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Image pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:19:38.136465 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 34/45] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Nov 24 15:19:38 2021] GET /compute/v2.1/os-snapshots/442ea50a-b406-4a03-b42e-62f70bc22921 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:19:38.137065 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:19:38.145999 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2fd220d4-87f9-43da-9df5-cee82651769e tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930dfe91f0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:38.163917 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:38.164367 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:38.165364 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:38.165806 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:38.208841 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Getting quotas for project 32404aa4e2d44b9e966da2bab0b27149. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:19:38.224896 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Getting quotas for user ede07ca84abc4ee6947d36c55591c84d and project 32404aa4e2d44b9e966da2bab0b27149. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:19:38.271695 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Going to run 1 instances... {{(pid=116073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:19:38.276827 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:19:38.414010 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-dcb23059-8ff6-480f-9c3f-5a72d48ef60b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.470359 Nov 24 15:19:38.418058 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 12/46] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:19:36 2021] POST /compute/v2.1/servers => generated 383 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:19:38.433498 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f2c1e882-e59b-4318-b1e3-97c2264bd440 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:38.434436 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-f2c1e882-e59b-4318-b1e3-97c2264bd440 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:38.466845 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2fd220d4-87f9-43da-9df5-cee82651769e tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/a94bfb65-4fd0-49db-beaa-c007f713f643" status: 202 len: 0 microversion: 2.1 time: 0.327563 Nov 24 15:19:38.471011 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 35/47] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Nov 24 15:19:38 2021] DELETE /compute/v2.1/os-volumes/a94bfb65-4fd0-49db-beaa-c007f713f643 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:19:38.478391 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fb037ba6-a4ce-433b-90af-88b6fbc40d8c tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930dfe9940>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:38.707194 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-f2c1e882-e59b-4318-b1e3-97c2264bd440 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:38.718266 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f2c1e882-e59b-4318-b1e3-97c2264bd440 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1222 microversion: 2.1 time: 0.290309 Nov 24 15:19:38.719936 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 13/48] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:38 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1222 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:38.767705 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-177d418b-3251-40cb-b4f1-572682221c87 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:38.768926 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-177d418b-3251-40cb-b4f1-572682221c87 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:38.783091 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-177d418b-3251-40cb-b4f1-572682221c87 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:38.787800 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-177d418b-3251-40cb-b4f1-572682221c87 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:38.790122 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-177d418b-3251-40cb-b4f1-572682221c87 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:38.792493 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-177d418b-3251-40cb-b4f1-572682221c87 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:39.038471 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-fb037ba6-a4ce-433b-90af-88b6fbc40d8c tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] HTTP exception thrown: Volume a94bfb65-4fd0-49db-beaa-c007f713f643 could not be found. Nov 24 15:19:39.039198 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fb037ba6-a4ce-433b-90af-88b6fbc40d8c tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Returning 404 to user: Volume a94bfb65-4fd0-49db-beaa-c007f713f643 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:19:39.040214 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fb037ba6-a4ce-433b-90af-88b6fbc40d8c tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/a94bfb65-4fd0-49db-beaa-c007f713f643" status: 404 len: 109 microversion: 2.1 time: 0.567622 Nov 24 15:19:39.041136 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 36/49] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:19:38 2021] GET /compute/v2.1/os-volumes/a94bfb65-4fd0-49db-beaa-c007f713f643 => generated 109 bytes in 569 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:19:39.055784 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-db88e9fb-9bd6-4a9c-8590-0cb1f8f777b5 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930dfe9700>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:39.233780 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-db88e9fb-9bd6-4a9c-8590-0cb1f8f777b5 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] HTTP exception thrown: Volume a94bfb65-4fd0-49db-beaa-c007f713f643 could not be found. Nov 24 15:19:39.234473 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-db88e9fb-9bd6-4a9c-8590-0cb1f8f777b5 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Returning 404 to user: Volume a94bfb65-4fd0-49db-beaa-c007f713f643 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:19:39.236906 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-db88e9fb-9bd6-4a9c-8590-0cb1f8f777b5 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/a94bfb65-4fd0-49db-beaa-c007f713f643" status: 404 len: 109 microversion: 2.1 time: 0.185017 Nov 24 15:19:39.238037 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 37/50] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Nov 24 15:19:39 2021] DELETE /compute/v2.1/os-volumes/a94bfb65-4fd0-49db-beaa-c007f713f643 => generated 109 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:19:39.265665 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c71f1ff0-f6f7-428e-9ddc-b9bdcfd2c0b2 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Calling method '.version_select at 0x7f930e8b0700>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:39.332718 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-c71f1ff0-f6f7-428e-9ddc-b9bdcfd2c0b2 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] HTTP exception thrown: Volume a94bfb65-4fd0-49db-beaa-c007f713f643 could not be found. Nov 24 15:19:39.334247 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c71f1ff0-f6f7-428e-9ddc-b9bdcfd2c0b2 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] Returning 404 to user: Volume a94bfb65-4fd0-49db-beaa-c007f713f643 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:19:39.335774 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c71f1ff0-f6f7-428e-9ddc-b9bdcfd2c0b2 tempest-VolumesSnapshotsTestJSON-1940203365 tempest-VolumesSnapshotsTestJSON-1940203365-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/a94bfb65-4fd0-49db-beaa-c007f713f643" status: 404 len: 109 microversion: 2.1 time: 0.085075 Nov 24 15:19:39.336451 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 38/51] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:19:39 2021] GET /compute/v2.1/os-volumes/a94bfb65-4fd0-49db-beaa-c007f713f643 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:19:39.486453 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-177d418b-3251-40cb-b4f1-572682221c87 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:39.551012 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-177d418b-3251-40cb-b4f1-572682221c87 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1273 microversion: 2.1 time: 0.788795 Nov 24 15:19:39.568748 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 14/52] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:38 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1273 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:39.735684 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d83f5c14-b7ee-4819-bc16-782b7c807d4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:39.736211 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d83f5c14-b7ee-4819-bc16-782b7c807d4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:39.743186 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d83f5c14-b7ee-4819-bc16-782b7c807d4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:39.743640 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d83f5c14-b7ee-4819-bc16-782b7c807d4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:39.744432 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d83f5c14-b7ee-4819-bc16-782b7c807d4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:39.744867 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d83f5c14-b7ee-4819-bc16-782b7c807d4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:40.277584 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d83f5c14-b7ee-4819-bc16-782b7c807d4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:40.288184 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d83f5c14-b7ee-4819-bc16-782b7c807d4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1226 microversion: 2.1 time: 0.556258 Nov 24 15:19:40.291358 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 39/53] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:39 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1226 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:40.576124 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a86b59d8-05f2-4e7b-847f-a3283dd1900e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:40.577263 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a86b59d8-05f2-4e7b-847f-a3283dd1900e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:40.618126 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a86b59d8-05f2-4e7b-847f-a3283dd1900e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:40.622991 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a86b59d8-05f2-4e7b-847f-a3283dd1900e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:40.625229 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a86b59d8-05f2-4e7b-847f-a3283dd1900e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:40.625871 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a86b59d8-05f2-4e7b-847f-a3283dd1900e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:41.242674 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-a86b59d8-05f2-4e7b-847f-a3283dd1900e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:41.254205 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a86b59d8-05f2-4e7b-847f-a3283dd1900e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.681310 Nov 24 15:19:41.266055 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 15/54] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:40 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:41.308106 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-74303e1c-acf8-4995-9f78-d316e70d8a3a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:41.309810 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-74303e1c-acf8-4995-9f78-d316e70d8a3a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:41.321984 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74303e1c-acf8-4995-9f78-d316e70d8a3a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:41.322675 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74303e1c-acf8-4995-9f78-d316e70d8a3a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:41.323674 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74303e1c-acf8-4995-9f78-d316e70d8a3a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:41.324263 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74303e1c-acf8-4995-9f78-d316e70d8a3a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:41.536967 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-74303e1c-acf8-4995-9f78-d316e70d8a3a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:41.550247 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-74303e1c-acf8-4995-9f78-d316e70d8a3a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1226 microversion: 2.1 time: 0.245551 Nov 24 15:19:41.553077 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 40/55] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:41 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1226 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:42.272487 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ccd8fdaf-0584-467c-895c-2c1ca58a7785 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:42.273405 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ccd8fdaf-0584-467c-895c-2c1ca58a7785 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:42.287312 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ccd8fdaf-0584-467c-895c-2c1ca58a7785 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:42.290250 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ccd8fdaf-0584-467c-895c-2c1ca58a7785 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:42.291298 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ccd8fdaf-0584-467c-895c-2c1ca58a7785 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:42.292695 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ccd8fdaf-0584-467c-895c-2c1ca58a7785 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:42.581292 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8d8cb561-a87a-4771-9c63-4b35ecba81f2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:42.583269 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8d8cb561-a87a-4771-9c63-4b35ecba81f2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:42.607084 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d8cb561-a87a-4771-9c63-4b35ecba81f2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:42.611633 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d8cb561-a87a-4771-9c63-4b35ecba81f2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:42.612709 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d8cb561-a87a-4771-9c63-4b35ecba81f2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:42.613311 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d8cb561-a87a-4771-9c63-4b35ecba81f2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:42.901002 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8d8cb561-a87a-4771-9c63-4b35ecba81f2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:42.908850 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8d8cb561-a87a-4771-9c63-4b35ecba81f2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1218 microversion: 2.1 time: 0.341264 Nov 24 15:19:42.923226 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 41/56] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:42 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1218 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:42.926887 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ccd8fdaf-0584-467c-895c-2c1ca58a7785 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:42.933070 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-258432121", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a227d49c-a3bd-45ee-b0d2-bcce569a4266"}], "security_groups": [{"name": "tempest-securitygroup--904273441"}], "key_name": "tempest-keypair-482992359", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:19:42.935757 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ccd8fdaf-0584-467c-895c-2c1ca58a7785 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.666965 Nov 24 15:19:42.941371 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 16/57] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:42 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:43.448894 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] validate_networks() for [('a227d49c-a3bd-45ee-b0d2-bcce569a4266', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:19:43.925956 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b1a93140-ad7e-4249-b411-ab9be20c977d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:43.926779 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b1a93140-ad7e-4249-b411-ab9be20c977d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:43.944457 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b1a93140-ad7e-4249-b411-ab9be20c977d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:43.949706 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b1a93140-ad7e-4249-b411-ab9be20c977d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:43.951379 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b1a93140-ad7e-4249-b411-ab9be20c977d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:43.957590 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b1a93140-ad7e-4249-b411-ab9be20c977d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:44.340014 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-b1a93140-ad7e-4249-b411-ab9be20c977d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:44.354543 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b1a93140-ad7e-4249-b411-ab9be20c977d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1274 microversion: 2.1 time: 0.432702 Nov 24 15:19:44.367278 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 17/58] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:43 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1274 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:44.380364 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-177bf990-2da0-42bb-8faf-5f18dbba0420 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:44.382452 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-177bf990-2da0-42bb-8faf-5f18dbba0420 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:44.409388 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-177bf990-2da0-42bb-8faf-5f18dbba0420 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:44.410214 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-177bf990-2da0-42bb-8faf-5f18dbba0420 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:44.411281 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-177bf990-2da0-42bb-8faf-5f18dbba0420 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:44.412115 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-177bf990-2da0-42bb-8faf-5f18dbba0420 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:44.809820 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-177bf990-2da0-42bb-8faf-5f18dbba0420 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:44.825256 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-177bf990-2da0-42bb-8faf-5f18dbba0420 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.454063 Nov 24 15:19:44.840178 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 18/59] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:44 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:45.373320 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2ecce58c-747b-4103-ad70-b62748f31d5c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:45.374703 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2ecce58c-747b-4103-ad70-b62748f31d5c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:45.387140 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2ecce58c-747b-4103-ad70-b62748f31d5c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:45.395088 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2ecce58c-747b-4103-ad70-b62748f31d5c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:45.396434 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2ecce58c-747b-4103-ad70-b62748f31d5c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:45.400213 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2ecce58c-747b-4103-ad70-b62748f31d5c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:45.843893 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-2ecce58c-747b-4103-ad70-b62748f31d5c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:45.862120 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2ecce58c-747b-4103-ad70-b62748f31d5c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1280 microversion: 2.1 time: 0.490849 Nov 24 15:19:45.864420 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 19/60] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:45 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1280 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:19:45.886332 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-bb6e68ec-e872-4b68-b510-2923962f16f1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:45.890113 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-bb6e68ec-e872-4b68-b510-2923962f16f1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:45.915241 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bb6e68ec-e872-4b68-b510-2923962f16f1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:45.916079 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bb6e68ec-e872-4b68-b510-2923962f16f1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:45.918004 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bb6e68ec-e872-4b68-b510-2923962f16f1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:45.918966 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bb6e68ec-e872-4b68-b510-2923962f16f1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:46.841094 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-bb6e68ec-e872-4b68-b510-2923962f16f1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:46.878397 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-bb6e68ec-e872-4b68-b510-2923962f16f1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 1.011493 Nov 24 15:19:46.885384 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 20/61] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:45 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:46.892092 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-aa6c50df-234c-4bbd-9579-ad4d26f85765 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:46.902280 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-aa6c50df-234c-4bbd-9579-ad4d26f85765 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:46.923036 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-aa6c50df-234c-4bbd-9579-ad4d26f85765 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:46.924051 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-aa6c50df-234c-4bbd-9579-ad4d26f85765 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:46.927823 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-aa6c50df-234c-4bbd-9579-ad4d26f85765 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:46.930395 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-aa6c50df-234c-4bbd-9579-ad4d26f85765 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:47.495415 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:19:47.495415 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:19:47.495415 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:19:47.495415 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:19:47.495415 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:19:47.507006 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:47.509670 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:47.510770 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:47.511776 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:47.551131 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Getting quotas for project cebad9fcbd0d4232a6f6dccb42ba04a1. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:19:47.562566 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Getting quotas for user a43cdd892899464190fa5a6cfc411ad0 and project cebad9fcbd0d4232a6f6dccb42ba04a1. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:19:47.594747 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:19:47.598430 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:19:47.686837 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-aa6c50df-234c-4bbd-9579-ad4d26f85765 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:47.694386 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-aa6c50df-234c-4bbd-9579-ad4d26f85765 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1280 microversion: 2.1 time: 0.807466 Nov 24 15:19:47.695006 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 21/62] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:46 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1280 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:47.778516 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5e086491-f5b4-4e8c-b033-e9a80ef4452e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.853673 Nov 24 15:19:47.779927 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 42/63] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:19:42 2021] POST /compute/v2.1/servers => generated 401 bytes in 4856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:19:47.789007 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3c70813d-fc1a-47da-b352-a5e16c93bb2f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:47.789622 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3c70813d-fc1a-47da-b352-a5e16c93bb2f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:47.901156 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1384a78a-b578-4732-bb86-97821924191b tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:47.901780 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1384a78a-b578-4732-bb86-97821924191b tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:47.918624 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1384a78a-b578-4732-bb86-97821924191b tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:47.919139 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1384a78a-b578-4732-bb86-97821924191b tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:47.919950 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1384a78a-b578-4732-bb86-97821924191b tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:47.920389 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1384a78a-b578-4732-bb86-97821924191b tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:48.287297 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-3c70813d-fc1a-47da-b352-a5e16c93bb2f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:48.294047 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3c70813d-fc1a-47da-b352-a5e16c93bb2f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1236 microversion: 2.1 time: 0.508560 Nov 24 15:19:48.295982 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 22/64] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:47 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1236 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:48.706208 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1384a78a-b578-4732-bb86-97821924191b tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:48.719657 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1384a78a-b578-4732-bb86-97821924191b tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.822445 Nov 24 15:19:48.730316 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 43/65] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:47 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:19:48.739737 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-41de115a-b24c-4198-8bec-6ebc56b3f21f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:48.741719 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-41de115a-b24c-4198-8bec-6ebc56b3f21f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:48.757199 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-41de115a-b24c-4198-8bec-6ebc56b3f21f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:48.757976 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-41de115a-b24c-4198-8bec-6ebc56b3f21f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:48.759453 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-41de115a-b24c-4198-8bec-6ebc56b3f21f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:48.764069 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-41de115a-b24c-4198-8bec-6ebc56b3f21f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:48.884184 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-41de115a-b24c-4198-8bec-6ebc56b3f21f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:48.896340 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-41de115a-b24c-4198-8bec-6ebc56b3f21f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1280 microversion: 2.1 time: 0.164237 Nov 24 15:19:48.897679 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 44/66] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:48 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1280 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:49.246435 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-00658b2b-6f25-43bd-9c22-246da75d4994 req-5c270c1a-23bf-45ba-b6df-5d2d8928c0ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c314c5fb-ef55-4d6a-907d-c67422d61401", "tag": "4ebc6af1-f8e1-4664-b0bd-51973f886e65"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:19:49.251111 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:19:49.251111 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:19:49.270633 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-00658b2b-6f25-43bd-9c22-246da75d4994 req-5c270c1a-23bf-45ba-b6df-5d2d8928c0ca service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:49.271279 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-00658b2b-6f25-43bd-9c22-246da75d4994 req-5c270c1a-23bf-45ba-b6df-5d2d8928c0ca service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:49.300508 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-00658b2b-6f25-43bd-9c22-246da75d4994 req-5c270c1a-23bf-45ba-b6df-5d2d8928c0ca service nova] Creating event network-changed:4ebc6af1-f8e1-4664-b0bd-51973f886e65 for instance c314c5fb-ef55-4d6a-907d-c67422d61401 on hv-cinder-80403 Nov 24 15:19:49.301292 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-00658b2b-6f25-43bd-9c22-246da75d4994 req-5c270c1a-23bf-45ba-b6df-5d2d8928c0ca service nova] Acquired lock "compute-rpcapi-router" {{(pid=116073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 24 15:19:49.302704 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d70e7131-34ff-4c8a-ba0e-fa5a6efe6b24 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:49.303311 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d70e7131-34ff-4c8a-ba0e-fa5a6efe6b24 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:49.304267 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d70e7131-34ff-4c8a-ba0e-fa5a6efe6b24 None None] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:49.304868 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d70e7131-34ff-4c8a-ba0e-fa5a6efe6b24 None None] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:49.315057 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.compute.rpcapi [None req-d70e7131-34ff-4c8a-ba0e-fa5a6efe6b24 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 24 15:19:49.315949 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d70e7131-34ff-4c8a-ba0e-fa5a6efe6b24 None None] Releasing lock "compute-rpcapi-router" {{(pid=116073) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 24 15:19:49.319113 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-28b13cba-12ff-4e38-9fc6-e46c59d12676 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:49.319732 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-28b13cba-12ff-4e38-9fc6-e46c59d12676 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:49.326447 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-28b13cba-12ff-4e38-9fc6-e46c59d12676 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:49.326925 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-28b13cba-12ff-4e38-9fc6-e46c59d12676 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:49.327927 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-28b13cba-12ff-4e38-9fc6-e46c59d12676 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:49.329065 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-28b13cba-12ff-4e38-9fc6-e46c59d12676 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:49.347191 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-d70e7131-34ff-4c8a-ba0e-fa5a6efe6b24 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.656704 Nov 24 15:19:49.348144 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 23/67] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:19:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:19:49.397440 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-28b13cba-12ff-4e38-9fc6-e46c59d12676 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:49.407897 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-28b13cba-12ff-4e38-9fc6-e46c59d12676 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1240 microversion: 2.1 time: 0.091558 Nov 24 15:19:49.408860 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 45/68] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:49 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:19:49.739820 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-14a7d986-f0c1-4610-aa08-12466c9edf23 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:49.747591 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-14a7d986-f0c1-4610-aa08-12466c9edf23 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:49.763882 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-14a7d986-f0c1-4610-aa08-12466c9edf23 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:49.765534 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-14a7d986-f0c1-4610-aa08-12466c9edf23 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:49.766916 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-14a7d986-f0c1-4610-aa08-12466c9edf23 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:49.767621 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-14a7d986-f0c1-4610-aa08-12466c9edf23 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:49.914475 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e6132c6a-e956-42ca-8495-a79f225172ae tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:49.917102 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e6132c6a-e956-42ca-8495-a79f225172ae tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:49.930414 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e6132c6a-e956-42ca-8495-a79f225172ae tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:49.931266 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e6132c6a-e956-42ca-8495-a79f225172ae tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:49.940977 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e6132c6a-e956-42ca-8495-a79f225172ae tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:49.943900 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e6132c6a-e956-42ca-8495-a79f225172ae tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:50.027358 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-14a7d986-f0c1-4610-aa08-12466c9edf23 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:50.039410 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-14a7d986-f0c1-4610-aa08-12466c9edf23 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.301084 Nov 24 15:19:50.050138 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 24/69] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:49 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:50.208671 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e6132c6a-e956-42ca-8495-a79f225172ae tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:50.218620 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e6132c6a-e956-42ca-8495-a79f225172ae tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1322 microversion: 2.1 time: 0.308172 Nov 24 15:19:50.224893 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 46/70] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:49 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:50.425500 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-929d0ef7-ed14-4dba-b3e8-f3cc36801fd0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:50.426128 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-929d0ef7-ed14-4dba-b3e8-f3cc36801fd0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:50.435026 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-929d0ef7-ed14-4dba-b3e8-f3cc36801fd0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:50.435951 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-929d0ef7-ed14-4dba-b3e8-f3cc36801fd0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:50.436340 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-929d0ef7-ed14-4dba-b3e8-f3cc36801fd0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:50.452883 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-929d0ef7-ed14-4dba-b3e8-f3cc36801fd0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:50.541734 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-929d0ef7-ed14-4dba-b3e8-f3cc36801fd0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:50.560945 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-929d0ef7-ed14-4dba-b3e8-f3cc36801fd0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1240 microversion: 2.1 time: 0.139003 Nov 24 15:19:50.572456 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 25/71] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:50 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1240 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:51.056201 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-63520b1b-e3ff-4fe3-beda-97b83a29ba47 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:51.059115 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-63520b1b-e3ff-4fe3-beda-97b83a29ba47 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:51.068688 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63520b1b-e3ff-4fe3-beda-97b83a29ba47 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:51.071484 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63520b1b-e3ff-4fe3-beda-97b83a29ba47 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:51.072634 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63520b1b-e3ff-4fe3-beda-97b83a29ba47 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:51.074295 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-63520b1b-e3ff-4fe3-beda-97b83a29ba47 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:51.238578 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-84b164bc-67b3-451c-9d18-4f87d32c529f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:51.239498 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-84b164bc-67b3-451c-9d18-4f87d32c529f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:51.247668 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-84b164bc-67b3-451c-9d18-4f87d32c529f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:51.248126 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-84b164bc-67b3-451c-9d18-4f87d32c529f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:51.248940 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-84b164bc-67b3-451c-9d18-4f87d32c529f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:51.249387 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-84b164bc-67b3-451c-9d18-4f87d32c529f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:51.378248 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-63520b1b-e3ff-4fe3-beda-97b83a29ba47 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:51.388761 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-63520b1b-e3ff-4fe3-beda-97b83a29ba47 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.334472 Nov 24 15:19:51.389358 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 47/72] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:51 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:51.581039 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-21b2f5a8-b472-4eab-a8cc-ece50e2e2ff6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:51.582228 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-21b2f5a8-b472-4eab-a8cc-ece50e2e2ff6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:51.591796 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21b2f5a8-b472-4eab-a8cc-ece50e2e2ff6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:51.596701 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21b2f5a8-b472-4eab-a8cc-ece50e2e2ff6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:51.598533 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21b2f5a8-b472-4eab-a8cc-ece50e2e2ff6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:51.601257 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-21b2f5a8-b472-4eab-a8cc-ece50e2e2ff6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:51.638622 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-84b164bc-67b3-451c-9d18-4f87d32c529f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:51.657702 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-84b164bc-67b3-451c-9d18-4f87d32c529f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1322 microversion: 2.1 time: 0.421804 Nov 24 15:19:51.658444 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 26/73] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:51 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:51.734684 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-21b2f5a8-b472-4eab-a8cc-ece50e2e2ff6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:51.742697 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-21b2f5a8-b472-4eab-a8cc-ece50e2e2ff6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1240 microversion: 2.1 time: 0.165957 Nov 24 15:19:51.743322 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 48/74] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:51 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1240 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:52.408191 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-793dea04-97f6-4f9f-b800-fa89f3af7893 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:52.408191 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-793dea04-97f6-4f9f-b800-fa89f3af7893 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:52.421600 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-793dea04-97f6-4f9f-b800-fa89f3af7893 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:52.425709 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-793dea04-97f6-4f9f-b800-fa89f3af7893 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:52.428552 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-793dea04-97f6-4f9f-b800-fa89f3af7893 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:52.433522 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-793dea04-97f6-4f9f-b800-fa89f3af7893 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:52.675522 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bb44e5db-5be5-4701-8279-642ab40825be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:52.676474 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bb44e5db-5be5-4701-8279-642ab40825be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:52.683211 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-793dea04-97f6-4f9f-b800-fa89f3af7893 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:52.690621 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bb44e5db-5be5-4701-8279-642ab40825be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:52.691797 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bb44e5db-5be5-4701-8279-642ab40825be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:52.691980 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-793dea04-97f6-4f9f-b800-fa89f3af7893 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.289645 Nov 24 15:19:52.692966 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bb44e5db-5be5-4701-8279-642ab40825be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:52.693516 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bb44e5db-5be5-4701-8279-642ab40825be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:52.700309 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 27/75] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:52 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:52.759482 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-e8a2309c-15ee-44f9-86bf-2b2d7edc8384 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:52.760102 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-e8a2309c-15ee-44f9-86bf-2b2d7edc8384 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:52.768028 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e8a2309c-15ee-44f9-86bf-2b2d7edc8384 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:52.769037 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e8a2309c-15ee-44f9-86bf-2b2d7edc8384 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:52.770002 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e8a2309c-15ee-44f9-86bf-2b2d7edc8384 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:52.770591 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e8a2309c-15ee-44f9-86bf-2b2d7edc8384 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:52.901306 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e8a2309c-15ee-44f9-86bf-2b2d7edc8384 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:52.930339 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-e8a2309c-15ee-44f9-86bf-2b2d7edc8384 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1240 microversion: 2.1 time: 0.165004 Nov 24 15:19:52.941763 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 28/76] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:52 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1240 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:19:52.974288 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bb44e5db-5be5-4701-8279-642ab40825be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:52.986054 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bb44e5db-5be5-4701-8279-642ab40825be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1322 microversion: 2.1 time: 0.314492 Nov 24 15:19:52.988577 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 49/77] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:52 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:19:53.715957 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-da3e1c6b-29fa-4d66-82a4-80342624ab8a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:53.716844 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-da3e1c6b-29fa-4d66-82a4-80342624ab8a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:53.735569 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-da3e1c6b-29fa-4d66-82a4-80342624ab8a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:53.736159 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-da3e1c6b-29fa-4d66-82a4-80342624ab8a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:53.737167 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-da3e1c6b-29fa-4d66-82a4-80342624ab8a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:53.737625 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-da3e1c6b-29fa-4d66-82a4-80342624ab8a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:53.951083 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e8fefced-6184-472d-9a66-73e06fb195f7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:53.951903 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e8fefced-6184-472d-9a66-73e06fb195f7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:53.954463 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-da3e1c6b-29fa-4d66-82a4-80342624ab8a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:53.962389 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e8fefced-6184-472d-9a66-73e06fb195f7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:53.964014 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-da3e1c6b-29fa-4d66-82a4-80342624ab8a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.252152 Nov 24 15:19:53.965666 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e8fefced-6184-472d-9a66-73e06fb195f7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:53.966750 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e8fefced-6184-472d-9a66-73e06fb195f7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:53.971112 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e8fefced-6184-472d-9a66-73e06fb195f7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:53.978132 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 29/78] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:53 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:54.003702 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-df171785-fe7a-4bb6-88e4-539008f9e8a4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:54.004323 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-df171785-fe7a-4bb6-88e4-539008f9e8a4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:54.019950 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-df171785-fe7a-4bb6-88e4-539008f9e8a4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:54.019950 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-df171785-fe7a-4bb6-88e4-539008f9e8a4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:54.019950 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-df171785-fe7a-4bb6-88e4-539008f9e8a4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:54.019950 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-df171785-fe7a-4bb6-88e4-539008f9e8a4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:54.043061 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e8fefced-6184-472d-9a66-73e06fb195f7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:54.051765 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e8fefced-6184-472d-9a66-73e06fb195f7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1240 microversion: 2.1 time: 0.105299 Nov 24 15:19:54.057771 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 50/79] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:53 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1240 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:54.197739 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-df171785-fe7a-4bb6-88e4-539008f9e8a4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:54.206449 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-df171785-fe7a-4bb6-88e4-539008f9e8a4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1322 microversion: 2.1 time: 0.206528 Nov 24 15:19:54.207067 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 30/80] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:53 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:19:54.984593 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c12e2c88-3542-4448-8cf0-b961d88ed29c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:54.984593 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c12e2c88-3542-4448-8cf0-b961d88ed29c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:54.990542 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c12e2c88-3542-4448-8cf0-b961d88ed29c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:54.991148 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c12e2c88-3542-4448-8cf0-b961d88ed29c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:54.992421 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c12e2c88-3542-4448-8cf0-b961d88ed29c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:54.993060 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c12e2c88-3542-4448-8cf0-b961d88ed29c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:55.073408 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4d613e9b-2989-4b5b-9e98-abe2297f78cc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:55.075568 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4d613e9b-2989-4b5b-9e98-abe2297f78cc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:55.083419 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4d613e9b-2989-4b5b-9e98-abe2297f78cc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:55.084150 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4d613e9b-2989-4b5b-9e98-abe2297f78cc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:55.085133 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4d613e9b-2989-4b5b-9e98-abe2297f78cc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:55.085959 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4d613e9b-2989-4b5b-9e98-abe2297f78cc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:55.168348 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4d613e9b-2989-4b5b-9e98-abe2297f78cc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:55.175228 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c12e2c88-3542-4448-8cf0-b961d88ed29c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:55.182371 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4d613e9b-2989-4b5b-9e98-abe2297f78cc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1240 microversion: 2.1 time: 0.112559 Nov 24 15:19:55.183204 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 31/81] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:55 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1240 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:55.183633 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c12e2c88-3542-4448-8cf0-b961d88ed29c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.205739 Nov 24 15:19:55.184214 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 51/82] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:54 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:55.268326 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2aa51c10-26db-4bd3-a8ca-01bb076676be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:55.268602 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2aa51c10-26db-4bd3-a8ca-01bb076676be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:55.275333 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2aa51c10-26db-4bd3-a8ca-01bb076676be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:55.275852 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2aa51c10-26db-4bd3-a8ca-01bb076676be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:55.276646 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2aa51c10-26db-4bd3-a8ca-01bb076676be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:55.277077 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2aa51c10-26db-4bd3-a8ca-01bb076676be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:55.437924 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-2aa51c10-26db-4bd3-a8ca-01bb076676be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:55.448679 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2aa51c10-26db-4bd3-a8ca-01bb076676be tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1322 microversion: 2.1 time: 0.187724 Nov 24 15:19:55.457533 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 32/83] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:55 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:19:56.201300 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-69164c4e-abbb-443a-a7f5-2b958a12dc51 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:56.201764 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-57b508da-d501-4d65-bd18-043896e2c318 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:56.202129 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-69164c4e-abbb-443a-a7f5-2b958a12dc51 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:56.202236 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-57b508da-d501-4d65-bd18-043896e2c318 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:56.209642 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69164c4e-abbb-443a-a7f5-2b958a12dc51 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:56.211331 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69164c4e-abbb-443a-a7f5-2b958a12dc51 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:56.212723 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-57b508da-d501-4d65-bd18-043896e2c318 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:56.213205 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-57b508da-d501-4d65-bd18-043896e2c318 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:56.214023 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-57b508da-d501-4d65-bd18-043896e2c318 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:56.214484 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-57b508da-d501-4d65-bd18-043896e2c318 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:56.214650 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69164c4e-abbb-443a-a7f5-2b958a12dc51 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:56.215251 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69164c4e-abbb-443a-a7f5-2b958a12dc51 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:56.342387 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-57b508da-d501-4d65-bd18-043896e2c318 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:56.350288 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-57b508da-d501-4d65-bd18-043896e2c318 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1288 microversion: 2.1 time: 0.152816 Nov 24 15:19:56.351440 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 33/84] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:56 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1288 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:56.465653 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-d68f8406-95f8-4894-8c93-e6c500e15cb5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:56.466563 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-d68f8406-95f8-4894-8c93-e6c500e15cb5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:56.476949 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d68f8406-95f8-4894-8c93-e6c500e15cb5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:56.478741 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d68f8406-95f8-4894-8c93-e6c500e15cb5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:56.479786 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d68f8406-95f8-4894-8c93-e6c500e15cb5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:56.481737 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d68f8406-95f8-4894-8c93-e6c500e15cb5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:56.819013 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-69164c4e-abbb-443a-a7f5-2b958a12dc51 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:56.826167 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-69164c4e-abbb-443a-a7f5-2b958a12dc51 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.628772 Nov 24 15:19:56.826738 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 52/85] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:56 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:57.010616 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-d68f8406-95f8-4894-8c93-e6c500e15cb5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:57.019178 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-d68f8406-95f8-4894-8c93-e6c500e15cb5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1322 microversion: 2.1 time: 0.557543 Nov 24 15:19:57.020797 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 34/86] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:56 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1322 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:19:57.367454 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ad82191a-9730-4988-846e-c52e9d0c1603 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:57.368052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ad82191a-9730-4988-846e-c52e9d0c1603 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:57.380512 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ad82191a-9730-4988-846e-c52e9d0c1603 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:57.381299 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ad82191a-9730-4988-846e-c52e9d0c1603 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:57.382361 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ad82191a-9730-4988-846e-c52e9d0c1603 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:57.383331 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ad82191a-9730-4988-846e-c52e9d0c1603 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:57.550188 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ad82191a-9730-4988-846e-c52e9d0c1603 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:57.571092 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ad82191a-9730-4988-846e-c52e9d0c1603 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1294 microversion: 2.1 time: 0.202470 Nov 24 15:19:57.574295 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 53/87] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:57 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1294 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:57.716975 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-cc850c73-0385-4977-8455-875e7e62aeaa req-52c2f397-57f4-4da3-9ccb-575e4760a8d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1b8192-257b-42e9-8aad-a40ce8bfb4f8", "tag": "ba4bd5dc-d328-477a-9c65-f3aeb75a0f70"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:19:57.720922 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:19:57.720922 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:19:57.729914 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-cc850c73-0385-4977-8455-875e7e62aeaa req-52c2f397-57f4-4da3-9ccb-575e4760a8d3 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:57.731068 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-cc850c73-0385-4977-8455-875e7e62aeaa req-52c2f397-57f4-4da3-9ccb-575e4760a8d3 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:57.748039 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-cc850c73-0385-4977-8455-875e7e62aeaa req-52c2f397-57f4-4da3-9ccb-575e4760a8d3 service nova] Creating event network-changed:ba4bd5dc-d328-477a-9c65-f3aeb75a0f70 for instance 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 on hv-cinder-80403 Nov 24 15:19:57.765746 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-cc850c73-0385-4977-8455-875e7e62aeaa req-52c2f397-57f4-4da3-9ccb-575e4760a8d3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218827 Nov 24 15:19:57.766841 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 35/88] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:19:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:57.847677 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a1e5d94a-ae8f-48f0-8498-faf22734002a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:57.848362 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a1e5d94a-ae8f-48f0-8498-faf22734002a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:57.854998 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1e5d94a-ae8f-48f0-8498-faf22734002a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:57.857591 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1e5d94a-ae8f-48f0-8498-faf22734002a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:57.860241 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1e5d94a-ae8f-48f0-8498-faf22734002a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:57.861699 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1e5d94a-ae8f-48f0-8498-faf22734002a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:58.037539 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-336ee77c-5fca-4ed9-ae66-a3898452985f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:58.038773 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-336ee77c-5fca-4ed9-ae66-a3898452985f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:58.051553 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-336ee77c-5fca-4ed9-ae66-a3898452985f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:58.054842 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-336ee77c-5fca-4ed9-ae66-a3898452985f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:58.056965 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-336ee77c-5fca-4ed9-ae66-a3898452985f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:58.058987 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-336ee77c-5fca-4ed9-ae66-a3898452985f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:58.646015 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a1e5d94a-ae8f-48f0-8498-faf22734002a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:58.655430 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a1e5d94a-ae8f-48f0-8498-faf22734002a tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.811241 Nov 24 15:19:58.666111 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 54/89] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:57 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:58.672313 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-1d696b9c-3337-4b5e-9217-0aafe7d9c2b2 req-3899fa6b-1ff6-43f6-ab7f-6b22e191a798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c23d97-138c-40a2-9593-8896dfdb2650", "tag": "78dc38d0-e790-4e67-9cc9-06ac9d53b726"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:19:58.675994 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:19:58.675994 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:19:58.690705 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1d696b9c-3337-4b5e-9217-0aafe7d9c2b2 req-3899fa6b-1ff6-43f6-ab7f-6b22e191a798 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:58.691650 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1d696b9c-3337-4b5e-9217-0aafe7d9c2b2 req-3899fa6b-1ff6-43f6-ab7f-6b22e191a798 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:58.721808 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-1d696b9c-3337-4b5e-9217-0aafe7d9c2b2 req-3899fa6b-1ff6-43f6-ab7f-6b22e191a798 service nova] Creating event network-changed:78dc38d0-e790-4e67-9cc9-06ac9d53b726 for instance 54c23d97-138c-40a2-9593-8896dfdb2650 on hv-cinder-80403 Nov 24 15:19:58.723292 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1d696b9c-3337-4b5e-9217-0aafe7d9c2b2 req-3899fa6b-1ff6-43f6-ab7f-6b22e191a798 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 24 15:19:58.724575 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38b56fe1-043d-4ed2-a82e-8a4489f315a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:58.725117 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38b56fe1-043d-4ed2-a82e-8a4489f315a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:58.726033 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38b56fe1-043d-4ed2-a82e-8a4489f315a4 None None] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:58.726561 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38b56fe1-043d-4ed2-a82e-8a4489f315a4 None None] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:58.740035 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.compute.rpcapi [None req-38b56fe1-043d-4ed2-a82e-8a4489f315a4 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 24 15:19:58.741969 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38b56fe1-043d-4ed2-a82e-8a4489f315a4 None None] Releasing lock "compute-rpcapi-router" {{(pid=116072) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 24 15:19:58.807031 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-38b56fe1-043d-4ed2-a82e-8a4489f315a4 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137969 Nov 24 15:19:58.807990 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 55/90] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:19:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:19:58.820416 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5fc0421b-006b-4ded-8d6d-7d232de67f3d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:58.823306 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5fc0421b-006b-4ded-8d6d-7d232de67f3d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:58.841361 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5fc0421b-006b-4ded-8d6d-7d232de67f3d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:58.842715 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5fc0421b-006b-4ded-8d6d-7d232de67f3d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:58.845054 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5fc0421b-006b-4ded-8d6d-7d232de67f3d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:58.848363 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5fc0421b-006b-4ded-8d6d-7d232de67f3d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:58.861090 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-336ee77c-5fca-4ed9-ae66-a3898452985f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:58.884514 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-336ee77c-5fca-4ed9-ae66-a3898452985f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1322 microversion: 2.1 time: 0.846186 Nov 24 15:19:58.885322 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 36/91] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:58 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1322 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:19:58.977830 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5fc0421b-006b-4ded-8d6d-7d232de67f3d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:58.986768 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5fc0421b-006b-4ded-8d6d-7d232de67f3d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1294 microversion: 2.1 time: 0.176189 Nov 24 15:19:58.988529 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 56/92] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:58 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1294 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:19:59.673190 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4fcef8e6-e4d0-4864-874b-98ce9f3a85b0 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:59.673801 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4fcef8e6-e4d0-4864-874b-98ce9f3a85b0 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:59.683796 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4fcef8e6-e4d0-4864-874b-98ce9f3a85b0 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:59.684173 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4fcef8e6-e4d0-4864-874b-98ce9f3a85b0 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:59.684964 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4fcef8e6-e4d0-4864-874b-98ce9f3a85b0 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:59.685397 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4fcef8e6-e4d0-4864-874b-98ce9f3a85b0 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:59.905316 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7fffd72d-bd4c-4e13-b816-bc9626f76a2b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:19:59.906027 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7fffd72d-bd4c-4e13-b816-bc9626f76a2b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:19:59.913924 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7fffd72d-bd4c-4e13-b816-bc9626f76a2b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:59.914427 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7fffd72d-bd4c-4e13-b816-bc9626f76a2b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:59.915211 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7fffd72d-bd4c-4e13-b816-bc9626f76a2b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:19:59.915642 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7fffd72d-bd4c-4e13-b816-bc9626f76a2b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:19:59.937552 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4fcef8e6-e4d0-4864-874b-98ce9f3a85b0 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:19:59.947857 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4fcef8e6-e4d0-4864-874b-98ce9f3a85b0 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.278489 Nov 24 15:19:59.948661 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 37/93] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:59 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:00.007006 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-e7efb789-80c7-4138-86c0-d29ce874b841 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:00.007864 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-e7efb789-80c7-4138-86c0-d29ce874b841 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:00.016727 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e7efb789-80c7-4138-86c0-d29ce874b841 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:00.017726 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e7efb789-80c7-4138-86c0-d29ce874b841 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:00.018893 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e7efb789-80c7-4138-86c0-d29ce874b841 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:00.019479 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e7efb789-80c7-4138-86c0-d29ce874b841 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:00.112531 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7fffd72d-bd4c-4e13-b816-bc9626f76a2b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:00.124003 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7fffd72d-bd4c-4e13-b816-bc9626f76a2b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1322 microversion: 2.1 time: 0.222744 Nov 24 15:20:00.124673 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 57/94] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:19:59 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:00.188905 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e7efb789-80c7-4138-86c0-d29ce874b841 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:00.196483 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-e7efb789-80c7-4138-86c0-d29ce874b841 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1361 microversion: 2.1 time: 0.194450 Nov 24 15:20:00.197290 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 38/95] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:00 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1361 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:00.964712 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cd3c8bca-c277-4528-98ae-01a3c8c0832d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:00.965922 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cd3c8bca-c277-4528-98ae-01a3c8c0832d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:00.972102 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cd3c8bca-c277-4528-98ae-01a3c8c0832d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:00.972808 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cd3c8bca-c277-4528-98ae-01a3c8c0832d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:00.973816 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cd3c8bca-c277-4528-98ae-01a3c8c0832d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:00.974357 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cd3c8bca-c277-4528-98ae-01a3c8c0832d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:01.138235 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cd3c8bca-c277-4528-98ae-01a3c8c0832d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:01.144816 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f1fefd85-5245-428a-bd85-bb89b5a23fef tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:01.146427 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-f1fefd85-5245-428a-bd85-bb89b5a23fef tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:01.152892 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cd3c8bca-c277-4528-98ae-01a3c8c0832d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.191411 Nov 24 15:20:01.154330 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 58/96] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:00 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:01.154835 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f1fefd85-5245-428a-bd85-bb89b5a23fef tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:01.155301 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f1fefd85-5245-428a-bd85-bb89b5a23fef tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:01.156092 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f1fefd85-5245-428a-bd85-bb89b5a23fef tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:01.156525 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f1fefd85-5245-428a-bd85-bb89b5a23fef tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:01.212923 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-403dd3a0-5e9d-4c23-aa90-0cec61eabc92 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:01.213524 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-403dd3a0-5e9d-4c23-aa90-0cec61eabc92 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:01.219450 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-403dd3a0-5e9d-4c23-aa90-0cec61eabc92 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:01.219896 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-403dd3a0-5e9d-4c23-aa90-0cec61eabc92 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:01.220663 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-403dd3a0-5e9d-4c23-aa90-0cec61eabc92 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:01.221093 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-403dd3a0-5e9d-4c23-aa90-0cec61eabc92 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:01.387490 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-f1fefd85-5245-428a-bd85-bb89b5a23fef tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:01.395282 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f1fefd85-5245-428a-bd85-bb89b5a23fef tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1322 microversion: 2.1 time: 0.257318 Nov 24 15:20:01.395978 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 39/97] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:01 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:01.414914 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-403dd3a0-5e9d-4c23-aa90-0cec61eabc92 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:01.423999 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-403dd3a0-5e9d-4c23-aa90-0cec61eabc92 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1361 microversion: 2.1 time: 0.214789 Nov 24 15:20:01.433100 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 59/98] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:01 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:02.170727 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-20860131-acd7-43da-82e5-44aa12d63157 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:02.171962 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-20860131-acd7-43da-82e5-44aa12d63157 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:02.178494 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-20860131-acd7-43da-82e5-44aa12d63157 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:02.179148 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-20860131-acd7-43da-82e5-44aa12d63157 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:02.180336 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-20860131-acd7-43da-82e5-44aa12d63157 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:02.180922 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-20860131-acd7-43da-82e5-44aa12d63157 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:02.413708 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-47e22392-b7d1-4305-9077-4d50c7b95c7b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:02.415150 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-47e22392-b7d1-4305-9077-4d50c7b95c7b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:02.433728 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-47e22392-b7d1-4305-9077-4d50c7b95c7b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:02.435362 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-47e22392-b7d1-4305-9077-4d50c7b95c7b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:02.438726 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-47e22392-b7d1-4305-9077-4d50c7b95c7b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:02.439363 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-47e22392-b7d1-4305-9077-4d50c7b95c7b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:02.553966 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-20860131-acd7-43da-82e5-44aa12d63157 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:02.565924 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-20860131-acd7-43da-82e5-44aa12d63157 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.396895 Nov 24 15:20:02.567364 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 40/99] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:02 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:02.577958 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ec30fa3d-81ff-4264-ba50-6a0dc6ad32df tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:02.579987 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ec30fa3d-81ff-4264-ba50-6a0dc6ad32df tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:02.595337 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ec30fa3d-81ff-4264-ba50-6a0dc6ad32df tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:02.599455 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ec30fa3d-81ff-4264-ba50-6a0dc6ad32df tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:02.600444 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ec30fa3d-81ff-4264-ba50-6a0dc6ad32df tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:02.601121 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ec30fa3d-81ff-4264-ba50-6a0dc6ad32df tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:03.080773 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-47e22392-b7d1-4305-9077-4d50c7b95c7b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:03.099161 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-47e22392-b7d1-4305-9077-4d50c7b95c7b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1322 microversion: 2.1 time: 0.685038 Nov 24 15:20:03.100144 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 60/100] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:02 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1322 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:03.116687 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-371186c4-3d04-4bfe-a33b-3c1e99e95032 req-b4acbe2a-ce9e-4031-b671-d9de415fb713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60818665-e1d1-4651-9b32-94b226a506c9", "tag": "f913887e-e2c7-4f41-9773-44b6265eb1f9"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:03.120667 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:20:03.120667 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:20:03.142036 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-371186c4-3d04-4bfe-a33b-3c1e99e95032 req-b4acbe2a-ce9e-4031-b671-d9de415fb713 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:03.142538 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-371186c4-3d04-4bfe-a33b-3c1e99e95032 req-b4acbe2a-ce9e-4031-b671-d9de415fb713 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:03.175122 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-371186c4-3d04-4bfe-a33b-3c1e99e95032 req-b4acbe2a-ce9e-4031-b671-d9de415fb713 service nova] Creating event network-changed:f913887e-e2c7-4f41-9773-44b6265eb1f9 for instance 60818665-e1d1-4651-9b32-94b226a506c9 on hv-cinder-80403 Nov 24 15:20:03.181454 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-371186c4-3d04-4bfe-a33b-3c1e99e95032 req-b4acbe2a-ce9e-4031-b671-d9de415fb713 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076677 Nov 24 15:20:03.182994 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 61/101] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:20:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:20:03.413320 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ec30fa3d-81ff-4264-ba50-6a0dc6ad32df tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:03.421998 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ec30fa3d-81ff-4264-ba50-6a0dc6ad32df tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1361 microversion: 2.1 time: 0.851446 Nov 24 15:20:03.425632 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 41/102] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:02 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1361 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:03.584692 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4f7941f1-e6fd-495d-b8df-6071ac6d6b17 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:03.585692 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4f7941f1-e6fd-495d-b8df-6071ac6d6b17 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:03.593119 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4f7941f1-e6fd-495d-b8df-6071ac6d6b17 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:03.593871 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4f7941f1-e6fd-495d-b8df-6071ac6d6b17 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:03.594741 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4f7941f1-e6fd-495d-b8df-6071ac6d6b17 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:03.595257 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4f7941f1-e6fd-495d-b8df-6071ac6d6b17 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:03.757186 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4f7941f1-e6fd-495d-b8df-6071ac6d6b17 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:03.767069 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4f7941f1-e6fd-495d-b8df-6071ac6d6b17 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.186615 Nov 24 15:20:03.776984 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 62/103] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:03 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:04.121317 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-566245ee-757b-4a17-b27f-76afc29d8438 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:04.122196 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-566245ee-757b-4a17-b27f-76afc29d8438 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:04.130193 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-566245ee-757b-4a17-b27f-76afc29d8438 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:04.130937 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-566245ee-757b-4a17-b27f-76afc29d8438 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:04.131919 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-566245ee-757b-4a17-b27f-76afc29d8438 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:04.132357 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-566245ee-757b-4a17-b27f-76afc29d8438 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:04.337587 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-566245ee-757b-4a17-b27f-76afc29d8438 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:04.345104 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-566245ee-757b-4a17-b27f-76afc29d8438 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1322 microversion: 2.1 time: 0.232821 Nov 24 15:20:04.347525 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 42/104] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:04 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:04.446790 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d5b7998b-fe02-46fc-954e-f85d8c7b11d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:04.447627 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d5b7998b-fe02-46fc-954e-f85d8c7b11d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:04.456834 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5b7998b-fe02-46fc-954e-f85d8c7b11d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:04.460119 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5b7998b-fe02-46fc-954e-f85d8c7b11d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:04.465801 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5b7998b-fe02-46fc-954e-f85d8c7b11d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:04.467302 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d5b7998b-fe02-46fc-954e-f85d8c7b11d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:04.683494 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d5b7998b-fe02-46fc-954e-f85d8c7b11d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:04.691496 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d5b7998b-fe02-46fc-954e-f85d8c7b11d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1361 microversion: 2.1 time: 0.252969 Nov 24 15:20:04.692278 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 63/105] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:04 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:04.784567 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-73179c52-cb07-4ee2-bba8-941b774b3a65 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:04.785464 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-73179c52-cb07-4ee2-bba8-941b774b3a65 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:04.792132 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-73179c52-cb07-4ee2-bba8-941b774b3a65 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:04.792644 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-73179c52-cb07-4ee2-bba8-941b774b3a65 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:04.793431 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-73179c52-cb07-4ee2-bba8-941b774b3a65 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:04.793868 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-73179c52-cb07-4ee2-bba8-941b774b3a65 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:05.024332 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-73179c52-cb07-4ee2-bba8-941b774b3a65 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:05.032396 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-73179c52-cb07-4ee2-bba8-941b774b3a65 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.251976 Nov 24 15:20:05.033275 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 43/106] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:04 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:05.364600 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-afa8f7b5-d69a-48dc-881e-d2ce15170c99 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:05.365243 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-afa8f7b5-d69a-48dc-881e-d2ce15170c99 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:05.372180 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-afa8f7b5-d69a-48dc-881e-d2ce15170c99 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:05.373386 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-afa8f7b5-d69a-48dc-881e-d2ce15170c99 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:05.374576 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-afa8f7b5-d69a-48dc-881e-d2ce15170c99 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:05.375310 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-afa8f7b5-d69a-48dc-881e-d2ce15170c99 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:05.554729 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-afa8f7b5-d69a-48dc-881e-d2ce15170c99 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:05.564031 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-afa8f7b5-d69a-48dc-881e-d2ce15170c99 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1322 microversion: 2.1 time: 0.203430 Nov 24 15:20:05.564869 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 64/107] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:05 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:05.660111 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-481e8394-437e-4471-a4b0-a0b84e8b4573 req-59b48e81-fae9-4b27-8468-274c3b62e6cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c314c5fb-ef55-4d6a-907d-c67422d61401", "name": "network-vif-plugged", "status": "completed", "tag": "4ebc6af1-f8e1-4664-b0bd-51973f886e65"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:05.661837 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:20:05.661837 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:20:05.677828 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-481e8394-437e-4471-a4b0-a0b84e8b4573 req-59b48e81-fae9-4b27-8468-274c3b62e6cc service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:05.678823 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-481e8394-437e-4471-a4b0-a0b84e8b4573 req-59b48e81-fae9-4b27-8468-274c3b62e6cc service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:05.713660 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-00d2ef7f-d428-403f-b24e-303a5f3182fd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:05.714993 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-00d2ef7f-d428-403f-b24e-303a5f3182fd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:05.723156 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-481e8394-437e-4471-a4b0-a0b84e8b4573 req-59b48e81-fae9-4b27-8468-274c3b62e6cc service nova] Creating event network-vif-plugged:4ebc6af1-f8e1-4664-b0bd-51973f886e65 for instance c314c5fb-ef55-4d6a-907d-c67422d61401 on hv-cinder-80403 Nov 24 15:20:05.746160 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-00d2ef7f-d428-403f-b24e-303a5f3182fd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:05.748023 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-00d2ef7f-d428-403f-b24e-303a5f3182fd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:05.749391 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-481e8394-437e-4471-a4b0-a0b84e8b4573 req-59b48e81-fae9-4b27-8468-274c3b62e6cc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170701 Nov 24 15:20:05.750430 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 44/108] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:20:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:20:05.751454 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-00d2ef7f-d428-403f-b24e-303a5f3182fd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:05.751967 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-00d2ef7f-d428-403f-b24e-303a5f3182fd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:06.040163 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-00d2ef7f-d428-403f-b24e-303a5f3182fd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:06.049934 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-7916dcd7-0458-49b5-bd2b-66e57ab0557f tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:06.051605 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-7916dcd7-0458-49b5-bd2b-66e57ab0557f tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:06.058901 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-00d2ef7f-d428-403f-b24e-303a5f3182fd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1361 microversion: 2.1 time: 0.353300 Nov 24 15:20:06.064755 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7916dcd7-0458-49b5-bd2b-66e57ab0557f tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:06.067696 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 65/109] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:05 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1361 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:06.080115 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7916dcd7-0458-49b5-bd2b-66e57ab0557f tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:06.081607 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7916dcd7-0458-49b5-bd2b-66e57ab0557f tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:06.082754 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7916dcd7-0458-49b5-bd2b-66e57ab0557f tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:06.319689 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-7916dcd7-0458-49b5-bd2b-66e57ab0557f tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:06.330247 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-7916dcd7-0458-49b5-bd2b-66e57ab0557f tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.284200 Nov 24 15:20:06.331562 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 45/110] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:06 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:06.581647 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c8760812-5fa2-418e-a4e4-ed37e6d25a6d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:06.582860 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c8760812-5fa2-418e-a4e4-ed37e6d25a6d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:06.589750 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8760812-5fa2-418e-a4e4-ed37e6d25a6d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:06.590753 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8760812-5fa2-418e-a4e4-ed37e6d25a6d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:06.592186 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8760812-5fa2-418e-a4e4-ed37e6d25a6d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:06.593085 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8760812-5fa2-418e-a4e4-ed37e6d25a6d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:06.766350 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c8760812-5fa2-418e-a4e4-ed37e6d25a6d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:06.774437 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c8760812-5fa2-418e-a4e4-ed37e6d25a6d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1322 microversion: 2.1 time: 0.197642 Nov 24 15:20:06.775314 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 66/111] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:06 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:07.085868 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c3f8c98b-649b-4e69-9ad1-c217accc91a9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:07.086380 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c3f8c98b-649b-4e69-9ad1-c217accc91a9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:07.094711 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c3f8c98b-649b-4e69-9ad1-c217accc91a9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:07.095410 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c3f8c98b-649b-4e69-9ad1-c217accc91a9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:07.096719 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c3f8c98b-649b-4e69-9ad1-c217accc91a9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:07.100323 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c3f8c98b-649b-4e69-9ad1-c217accc91a9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:07.310090 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c3f8c98b-649b-4e69-9ad1-c217accc91a9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:07.318375 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c3f8c98b-649b-4e69-9ad1-c217accc91a9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1361 microversion: 2.1 time: 0.237514 Nov 24 15:20:07.319074 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 46/112] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:07 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:07.348113 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f58cf573-ec40-4b4f-b96e-b9818eb6ca66 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:07.349129 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f58cf573-ec40-4b4f-b96e-b9818eb6ca66 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:07.356323 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f58cf573-ec40-4b4f-b96e-b9818eb6ca66 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:07.356773 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f58cf573-ec40-4b4f-b96e-b9818eb6ca66 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:07.357653 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f58cf573-ec40-4b4f-b96e-b9818eb6ca66 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:07.357992 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f58cf573-ec40-4b4f-b96e-b9818eb6ca66 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:07.595277 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f58cf573-ec40-4b4f-b96e-b9818eb6ca66 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:07.603323 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f58cf573-ec40-4b4f-b96e-b9818eb6ca66 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1315 microversion: 2.1 time: 0.260117 Nov 24 15:20:07.603895 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 67/113] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:07 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:07.793018 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3aa5cb59-fe73-4e39-bd1b-9622a6643805 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:07.793542 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3aa5cb59-fe73-4e39-bd1b-9622a6643805 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:07.800256 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3aa5cb59-fe73-4e39-bd1b-9622a6643805 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:07.800850 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3aa5cb59-fe73-4e39-bd1b-9622a6643805 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:07.801673 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3aa5cb59-fe73-4e39-bd1b-9622a6643805 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:07.802110 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3aa5cb59-fe73-4e39-bd1b-9622a6643805 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:07.817293 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-85fb2668-30d1-4e5c-b229-f8f2b7e0b2ce req-a56c443d-a7e1-42e9-9b4a-560ab44ec770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1b8192-257b-42e9-8aad-a40ce8bfb4f8", "name": "network-vif-plugged", "status": "completed", "tag": "ba4bd5dc-d328-477a-9c65-f3aeb75a0f70"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:07.819105 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:20:07.819105 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:20:07.826042 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-85fb2668-30d1-4e5c-b229-f8f2b7e0b2ce req-a56c443d-a7e1-42e9-9b4a-560ab44ec770 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:07.826705 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-85fb2668-30d1-4e5c-b229-f8f2b7e0b2ce req-a56c443d-a7e1-42e9-9b4a-560ab44ec770 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:07.837854 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-85fb2668-30d1-4e5c-b229-f8f2b7e0b2ce req-a56c443d-a7e1-42e9-9b4a-560ab44ec770 service nova] Creating event network-vif-plugged:ba4bd5dc-d328-477a-9c65-f3aeb75a0f70 for instance 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 on hv-cinder-80403 Nov 24 15:20:07.845917 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-85fb2668-30d1-4e5c-b229-f8f2b7e0b2ce req-a56c443d-a7e1-42e9-9b4a-560ab44ec770 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032103 Nov 24 15:20:07.846729 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 68/114] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:20:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:20:07.964941 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-3aa5cb59-fe73-4e39-bd1b-9622a6643805 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:07.977547 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3aa5cb59-fe73-4e39-bd1b-9622a6643805 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1322 microversion: 2.1 time: 0.188007 Nov 24 15:20:07.978905 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 47/115] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:07 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:08.336428 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9ed09e50-fe6b-422c-9326-0e77015df67c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:08.337119 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9ed09e50-fe6b-422c-9326-0e77015df67c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:08.343446 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ed09e50-fe6b-422c-9326-0e77015df67c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:08.343988 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ed09e50-fe6b-422c-9326-0e77015df67c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:08.344834 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ed09e50-fe6b-422c-9326-0e77015df67c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:08.345332 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ed09e50-fe6b-422c-9326-0e77015df67c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:08.553543 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9ed09e50-fe6b-422c-9326-0e77015df67c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:08.564529 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9ed09e50-fe6b-422c-9326-0e77015df67c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1361 microversion: 2.1 time: 0.230708 Nov 24 15:20:08.565638 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 69/116] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:08 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:08.621473 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-db44aaa1-3e50-4f74-9c60-97bda2d3d4cc tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:08.624213 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-db44aaa1-3e50-4f74-9c60-97bda2d3d4cc tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:08.631652 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-db44aaa1-3e50-4f74-9c60-97bda2d3d4cc tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:08.635250 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-db44aaa1-3e50-4f74-9c60-97bda2d3d4cc tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:08.636084 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-db44aaa1-3e50-4f74-9c60-97bda2d3d4cc tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:08.636528 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-db44aaa1-3e50-4f74-9c60-97bda2d3d4cc tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:08.818994 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-db44aaa1-3e50-4f74-9c60-97bda2d3d4cc tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:08.828925 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-db44aaa1-3e50-4f74-9c60-97bda2d3d4cc tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1501 microversion: 2.1 time: 0.210838 Nov 24 15:20:08.841103 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 48/117] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:08 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1501 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:08.996772 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ef0041a4-b32e-498e-aaad-6ef62f7888ad tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:08.997388 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ef0041a4-b32e-498e-aaad-6ef62f7888ad tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:09.004433 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ef0041a4-b32e-498e-aaad-6ef62f7888ad tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:09.005111 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ef0041a4-b32e-498e-aaad-6ef62f7888ad tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:09.006115 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ef0041a4-b32e-498e-aaad-6ef62f7888ad tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:09.006757 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ef0041a4-b32e-498e-aaad-6ef62f7888ad tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:09.277366 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ef0041a4-b32e-498e-aaad-6ef62f7888ad tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:09.286589 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ef0041a4-b32e-498e-aaad-6ef62f7888ad tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1322 microversion: 2.1 time: 0.293936 Nov 24 15:20:09.288515 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 70/118] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:08 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:09.581953 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-cb0af1d2-8704-49b6-9fc6-1bffc40881fc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:09.582871 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-cb0af1d2-8704-49b6-9fc6-1bffc40881fc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:09.595999 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cb0af1d2-8704-49b6-9fc6-1bffc40881fc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:09.596745 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cb0af1d2-8704-49b6-9fc6-1bffc40881fc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:09.597558 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cb0af1d2-8704-49b6-9fc6-1bffc40881fc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:09.603846 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cb0af1d2-8704-49b6-9fc6-1bffc40881fc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:09.864508 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-7fa8ab3f-a1e5-49a1-a49d-816814206da5 req-b79098e4-e3f8-4ec4-8f9f-07072859da87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c23d97-138c-40a2-9593-8896dfdb2650", "name": "network-vif-plugged", "status": "completed", "tag": "78dc38d0-e790-4e67-9cc9-06ac9d53b726"}, {"server_uuid": "60818665-e1d1-4651-9b32-94b226a506c9", "name": "network-vif-plugged", "status": "completed", "tag": "f913887e-e2c7-4f41-9773-44b6265eb1f9"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:09.866342 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:20:09.866342 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:20:09.879560 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7fa8ab3f-a1e5-49a1-a49d-816814206da5 req-b79098e4-e3f8-4ec4-8f9f-07072859da87 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:09.883856 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7fa8ab3f-a1e5-49a1-a49d-816814206da5 req-b79098e4-e3f8-4ec4-8f9f-07072859da87 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:09.886194 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-cb0af1d2-8704-49b6-9fc6-1bffc40881fc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:09.910473 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-7fa8ab3f-a1e5-49a1-a49d-816814206da5 req-b79098e4-e3f8-4ec4-8f9f-07072859da87 service nova] Creating event network-vif-plugged:78dc38d0-e790-4e67-9cc9-06ac9d53b726 for instance 54c23d97-138c-40a2-9593-8896dfdb2650 on hv-cinder-80403 Nov 24 15:20:09.911249 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-7fa8ab3f-a1e5-49a1-a49d-816814206da5 req-b79098e4-e3f8-4ec4-8f9f-07072859da87 service nova] Creating event network-vif-plugged:f913887e-e2c7-4f41-9773-44b6265eb1f9 for instance 60818665-e1d1-4651-9b32-94b226a506c9 on hv-cinder-80403 Nov 24 15:20:09.917962 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-7fa8ab3f-a1e5-49a1-a49d-816814206da5 req-b79098e4-e3f8-4ec4-8f9f-07072859da87 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057567 Nov 24 15:20:09.918637 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 71/119] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:20:09 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:20:09.926875 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-cb0af1d2-8704-49b6-9fc6-1bffc40881fc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1361 microversion: 2.1 time: 0.349109 Nov 24 15:20:09.929983 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 49/120] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:09 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1361 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:10.314044 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1d3bccaf-6e9b-4b56-bcad-72f37ed32d91 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:10.315110 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1d3bccaf-6e9b-4b56-bcad-72f37ed32d91 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:10.321529 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1d3bccaf-6e9b-4b56-bcad-72f37ed32d91 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:10.322353 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1d3bccaf-6e9b-4b56-bcad-72f37ed32d91 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:10.323573 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1d3bccaf-6e9b-4b56-bcad-72f37ed32d91 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:10.324186 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1d3bccaf-6e9b-4b56-bcad-72f37ed32d91 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:10.541805 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6a1c58cd-1f30-4194-8c99-a0e4e022b9ba tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96af5737-3ccb-4d4d-b424-0f154118fa09"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:10.542949 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6a1c58cd-1f30-4194-8c99-a0e4e022b9ba tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:10.552576 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6a1c58cd-1f30-4194-8c99-a0e4e022b9ba tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:10.554215 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6a1c58cd-1f30-4194-8c99-a0e4e022b9ba tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:10.555314 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6a1c58cd-1f30-4194-8c99-a0e4e022b9ba tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:10.557976 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6a1c58cd-1f30-4194-8c99-a0e4e022b9ba tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:10.588827 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1d3bccaf-6e9b-4b56-bcad-72f37ed32d91 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:10.599394 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1d3bccaf-6e9b-4b56-bcad-72f37ed32d91 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1515 microversion: 2.1 time: 0.290725 Nov 24 15:20:10.613075 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 72/121] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:10 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1515 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:10.620925 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-defd7c12-9e3e-4e6b-9aad-43b176f9b122 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:10.622602 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-defd7c12-9e3e-4e6b-9aad-43b176f9b122 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:10.633819 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-defd7c12-9e3e-4e6b-9aad-43b176f9b122 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:10.634584 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-defd7c12-9e3e-4e6b-9aad-43b176f9b122 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:10.636054 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-defd7c12-9e3e-4e6b-9aad-43b176f9b122 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:10.636821 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-defd7c12-9e3e-4e6b-9aad-43b176f9b122 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:10.762064 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-defd7c12-9e3e-4e6b-9aad-43b176f9b122 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lazy-loading 'flavor' on Instance uuid 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:20:10.970358 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-defd7c12-9e3e-4e6b-9aad-43b176f9b122 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "POST /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8/action" status: 200 len: 32 microversion: 2.1 time: 0.355227 Nov 24 15:20:10.972073 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 73/122] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:10 2021] POST /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8/action => generated 32 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:20:10.985806 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-436d8ce3-2d1e-4ed7-8dad-50d50e9b1484 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:10.992833 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-436d8ce3-2d1e-4ed7-8dad-50d50e9b1484 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:11.001043 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-436d8ce3-2d1e-4ed7-8dad-50d50e9b1484 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:11.001667 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-436d8ce3-2d1e-4ed7-8dad-50d50e9b1484 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:11.002988 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-436d8ce3-2d1e-4ed7-8dad-50d50e9b1484 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:11.003584 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-436d8ce3-2d1e-4ed7-8dad-50d50e9b1484 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:11.145195 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6a1c58cd-1f30-4194-8c99-a0e4e022b9ba tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "POST /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.606123 Nov 24 15:20:11.146417 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 50/123] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Nov 24 15:20:10 2021] POST /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401/os-volume_attachments => generated 194 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:20:11.165577 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4e85a045-26fe-4299-90b5-a7e074d04afa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:11.166758 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4e85a045-26fe-4299-90b5-a7e074d04afa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:11.176880 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4e85a045-26fe-4299-90b5-a7e074d04afa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:11.178126 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4e85a045-26fe-4299-90b5-a7e074d04afa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:11.179461 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4e85a045-26fe-4299-90b5-a7e074d04afa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:11.180101 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4e85a045-26fe-4299-90b5-a7e074d04afa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:11.422028 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-436d8ce3-2d1e-4ed7-8dad-50d50e9b1484 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:11.431617 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-436d8ce3-2d1e-4ed7-8dad-50d50e9b1484 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1361 microversion: 2.1 time: 0.457474 Nov 24 15:20:11.436834 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 74/124] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:10 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1361 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:11.525345 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4e85a045-26fe-4299-90b5-a7e074d04afa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:11.539663 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4e85a045-26fe-4299-90b5-a7e074d04afa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.389226 Nov 24 15:20:11.542574 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 51/125] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:11 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:12.451787 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a6480f2f-7866-4bf9-ab51-ab36035bab91 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:12.453097 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a6480f2f-7866-4bf9-ab51-ab36035bab91 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:12.464455 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6480f2f-7866-4bf9-ab51-ab36035bab91 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:12.464866 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6480f2f-7866-4bf9-ab51-ab36035bab91 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:12.465781 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6480f2f-7866-4bf9-ab51-ab36035bab91 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:12.466258 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6480f2f-7866-4bf9-ab51-ab36035bab91 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:12.562269 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-49d2ebe3-ab66-47f3-9e41-c0a768dd0e54 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:12.563173 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-49d2ebe3-ab66-47f3-9e41-c0a768dd0e54 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:12.572641 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-49d2ebe3-ab66-47f3-9e41-c0a768dd0e54 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:12.573492 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-49d2ebe3-ab66-47f3-9e41-c0a768dd0e54 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:12.575110 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-49d2ebe3-ab66-47f3-9e41-c0a768dd0e54 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:12.575897 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-49d2ebe3-ab66-47f3-9e41-c0a768dd0e54 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:12.710753 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a6480f2f-7866-4bf9-ab51-ab36035bab91 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:12.719836 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a6480f2f-7866-4bf9-ab51-ab36035bab91 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1547 microversion: 2.1 time: 0.272300 Nov 24 15:20:12.720890 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 75/126] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:12 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1547 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:12.737659 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-55d5b0cd-65f1-4c50-89bf-b522911dd5df tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:12.738329 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-55d5b0cd-65f1-4c50-89bf-b522911dd5df tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:12.745902 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55d5b0cd-65f1-4c50-89bf-b522911dd5df tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:12.746543 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55d5b0cd-65f1-4c50-89bf-b522911dd5df tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:12.747741 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55d5b0cd-65f1-4c50-89bf-b522911dd5df tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:12.748328 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55d5b0cd-65f1-4c50-89bf-b522911dd5df tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:12.925090 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-55d5b0cd-65f1-4c50-89bf-b522911dd5df tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.191396 Nov 24 15:20:12.925663 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 76/127] 10.222.0.66 () {58 vars in 1274 bytes} [Wed Nov 24 15:20:12 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/os-interface => generated 284 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:20:12.932450 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-49d2ebe3-ab66-47f3-9e41-c0a768dd0e54 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:12.943211 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-49d2ebe3-ab66-47f3-9e41-c0a768dd0e54 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.384639 Nov 24 15:20:12.953739 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 52/128] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:12 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:13.969892 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-18cd1ad7-aeef-4b83-9b88-a777d21538e9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:13.970534 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-18cd1ad7-aeef-4b83-9b88-a777d21538e9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:13.993542 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-18cd1ad7-aeef-4b83-9b88-a777d21538e9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:13.997116 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-18cd1ad7-aeef-4b83-9b88-a777d21538e9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:13.999023 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-18cd1ad7-aeef-4b83-9b88-a777d21538e9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:14.001683 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-18cd1ad7-aeef-4b83-9b88-a777d21538e9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:14.209780 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-18cd1ad7-aeef-4b83-9b88-a777d21538e9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:14.224282 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-18cd1ad7-aeef-4b83-9b88-a777d21538e9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.266042 Nov 24 15:20:14.225187 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 77/129] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:13 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:15.192063 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-5c815cb4-73b0-4bca-8e73-a80e17e661cd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:15.194101 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-5c815cb4-73b0-4bca-8e73-a80e17e661cd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:15.210052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-c9f7057e-2a47-4f89-8078-51ffa1f3dc37 req-5f3b6529-b0d4-4537-a6e0-41e3bb023367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60818665-e1d1-4651-9b32-94b226a506c9", "tag": "f913887e-e2c7-4f41-9773-44b6265eb1f9"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:15.212361 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:20:15.212361 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:20:15.219613 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c815cb4-73b0-4bca-8e73-a80e17e661cd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:15.222172 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c815cb4-73b0-4bca-8e73-a80e17e661cd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:15.224586 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-c9f7057e-2a47-4f89-8078-51ffa1f3dc37 req-5f3b6529-b0d4-4537-a6e0-41e3bb023367 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:15.224961 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-c9f7057e-2a47-4f89-8078-51ffa1f3dc37 req-5f3b6529-b0d4-4537-a6e0-41e3bb023367 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:15.235724 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c815cb4-73b0-4bca-8e73-a80e17e661cd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:15.235724 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c815cb4-73b0-4bca-8e73-a80e17e661cd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:15.258773 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-c9f7057e-2a47-4f89-8078-51ffa1f3dc37 req-5f3b6529-b0d4-4537-a6e0-41e3bb023367 service nova] Creating event network-changed:f913887e-e2c7-4f41-9773-44b6265eb1f9 for instance 60818665-e1d1-4651-9b32-94b226a506c9 on hv-cinder-80403 Nov 24 15:20:15.272271 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-c9f7057e-2a47-4f89-8078-51ffa1f3dc37 req-5f3b6529-b0d4-4537-a6e0-41e3bb023367 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063068 Nov 24 15:20:15.278715 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 78/130] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:20:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:20:15.296052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-99f13576-835b-423f-95e8-418be2f12742 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:15.298418 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-99f13576-835b-423f-95e8-418be2f12742 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:15.312221 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99f13576-835b-423f-95e8-418be2f12742 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:15.313069 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99f13576-835b-423f-95e8-418be2f12742 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:15.314257 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99f13576-835b-423f-95e8-418be2f12742 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:15.315235 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99f13576-835b-423f-95e8-418be2f12742 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:15.367284 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-5c815cb4-73b0-4bca-8e73-a80e17e661cd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 14 microversion: 2.1 time: 0.178833 Nov 24 15:20:15.368153 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 53/131] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:15 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:20:15.803478 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-99f13576-835b-423f-95e8-418be2f12742 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:15.818503 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-99f13576-835b-423f-95e8-418be2f12742 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.536241 Nov 24 15:20:15.821126 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 79/132] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:15 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:16.382029 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8f5fa501-7389-452f-ade0-dc793b77ea0c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:16.384210 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8f5fa501-7389-452f-ade0-dc793b77ea0c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:16.398798 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f5fa501-7389-452f-ade0-dc793b77ea0c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:16.399364 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f5fa501-7389-452f-ade0-dc793b77ea0c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:16.400223 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f5fa501-7389-452f-ade0-dc793b77ea0c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:16.400955 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f5fa501-7389-452f-ade0-dc793b77ea0c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:16.474573 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8f5fa501-7389-452f-ade0-dc793b77ea0c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 14 microversion: 2.1 time: 0.100273 Nov 24 15:20:16.475612 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 54/133] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:16 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:20:16.840471 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8ba9a4f5-f111-4855-a666-487c7f6dd6c4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:16.841760 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8ba9a4f5-f111-4855-a666-487c7f6dd6c4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:16.852695 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8ba9a4f5-f111-4855-a666-487c7f6dd6c4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:16.853402 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8ba9a4f5-f111-4855-a666-487c7f6dd6c4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:16.854189 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8ba9a4f5-f111-4855-a666-487c7f6dd6c4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:16.854617 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8ba9a4f5-f111-4855-a666-487c7f6dd6c4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:17.043529 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8ba9a4f5-f111-4855-a666-487c7f6dd6c4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:17.056323 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8ba9a4f5-f111-4855-a666-487c7f6dd6c4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.221137 Nov 24 15:20:17.067150 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 80/134] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:16 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:17.486980 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-95935aec-a92a-44e4-ae13-8ba437e7f8ba tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:17.488448 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-95935aec-a92a-44e4-ae13-8ba437e7f8ba tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:17.505708 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-95935aec-a92a-44e4-ae13-8ba437e7f8ba tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:17.511732 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-95935aec-a92a-44e4-ae13-8ba437e7f8ba tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:17.512608 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-95935aec-a92a-44e4-ae13-8ba437e7f8ba tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:17.514525 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-95935aec-a92a-44e4-ae13-8ba437e7f8ba tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:17.623250 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-95935aec-a92a-44e4-ae13-8ba437e7f8ba tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 14 microversion: 2.1 time: 0.140342 Nov 24 15:20:17.624079 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 55/135] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:17 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:20:18.076951 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5e0f2d3d-0c93-42da-9055-e2faf2d2c8b1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:18.078831 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5e0f2d3d-0c93-42da-9055-e2faf2d2c8b1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:18.086548 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e0f2d3d-0c93-42da-9055-e2faf2d2c8b1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:18.088290 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e0f2d3d-0c93-42da-9055-e2faf2d2c8b1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:18.090109 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e0f2d3d-0c93-42da-9055-e2faf2d2c8b1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:18.090973 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5e0f2d3d-0c93-42da-9055-e2faf2d2c8b1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:18.306066 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5e0f2d3d-0c93-42da-9055-e2faf2d2c8b1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:18.315813 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5e0f2d3d-0c93-42da-9055-e2faf2d2c8b1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.243640 Nov 24 15:20:18.316426 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 81/136] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:18 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:18.634559 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-e8e09642-4c43-433f-a856-975a81a6c8fb tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:18.636808 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-e8e09642-4c43-433f-a856-975a81a6c8fb tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:18.645873 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e8e09642-4c43-433f-a856-975a81a6c8fb tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:18.646544 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e8e09642-4c43-433f-a856-975a81a6c8fb tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:18.647709 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e8e09642-4c43-433f-a856-975a81a6c8fb tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:18.648376 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e8e09642-4c43-433f-a856-975a81a6c8fb tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:18.731468 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-e8e09642-4c43-433f-a856-975a81a6c8fb tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 14 microversion: 2.1 time: 0.100250 Nov 24 15:20:18.733240 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 56/137] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:18 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:20:19.332840 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f9ebefbe-abb1-4786-9670-7493c25fc74b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:19.333460 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f9ebefbe-abb1-4786-9670-7493c25fc74b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:19.339788 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f9ebefbe-abb1-4786-9670-7493c25fc74b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:19.340234 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f9ebefbe-abb1-4786-9670-7493c25fc74b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:19.341016 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f9ebefbe-abb1-4786-9670-7493c25fc74b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:19.341446 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f9ebefbe-abb1-4786-9670-7493c25fc74b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:19.497398 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f9ebefbe-abb1-4786-9670-7493c25fc74b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:19.506096 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f9ebefbe-abb1-4786-9670-7493c25fc74b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.176772 Nov 24 15:20:19.506815 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 82/138] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:19 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:19.744052 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-da595bb5-f5b3-48b4-9077-f36960c0e61b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:19.745574 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-da595bb5-f5b3-48b4-9077-f36960c0e61b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:19.753707 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-da595bb5-f5b3-48b4-9077-f36960c0e61b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:19.754339 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-da595bb5-f5b3-48b4-9077-f36960c0e61b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:19.755338 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-da595bb5-f5b3-48b4-9077-f36960c0e61b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:19.755932 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-da595bb5-f5b3-48b4-9077-f36960c0e61b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:19.847101 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-da595bb5-f5b3-48b4-9077-f36960c0e61b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 14 microversion: 2.1 time: 0.106862 Nov 24 15:20:19.848218 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 57/139] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:19 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:20:20.163784 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-641dace8-f18b-4a65-96f5-d08cbef1d02d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:20.164377 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-641dace8-f18b-4a65-96f5-d08cbef1d02d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:20.170449 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-641dace8-f18b-4a65-96f5-d08cbef1d02d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:20.171536 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-641dace8-f18b-4a65-96f5-d08cbef1d02d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:20.172428 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-641dace8-f18b-4a65-96f5-d08cbef1d02d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:20.173073 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-641dace8-f18b-4a65-96f5-d08cbef1d02d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:20.207253 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-641dace8-f18b-4a65-96f5-d08cbef1d02d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:20:20.335462 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-641dace8-f18b-4a65-96f5-d08cbef1d02d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 204 len: 0 microversion: 2.1 time: 0.174918 Nov 24 15:20:20.336144 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 83/140] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:20:20 2021] DELETE /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:20:20.346921 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f37ef0c0-e6bc-4bb8-b586-fdbcfc065b41 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:20.347635 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-f37ef0c0-e6bc-4bb8-b586-fdbcfc065b41 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:20.356780 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f37ef0c0-e6bc-4bb8-b586-fdbcfc065b41 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:20.357223 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f37ef0c0-e6bc-4bb8-b586-fdbcfc065b41 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:20.358068 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f37ef0c0-e6bc-4bb8-b586-fdbcfc065b41 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:20.359224 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f37ef0c0-e6bc-4bb8-b586-fdbcfc065b41 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:20.529584 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6268542c-e3ff-4822-a3af-033756b387e6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:20.531098 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6268542c-e3ff-4822-a3af-033756b387e6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:20.539066 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6268542c-e3ff-4822-a3af-033756b387e6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:20.539575 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6268542c-e3ff-4822-a3af-033756b387e6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:20.540470 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6268542c-e3ff-4822-a3af-033756b387e6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:20.540881 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6268542c-e3ff-4822-a3af-033756b387e6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:20.545615 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-f37ef0c0-e6bc-4bb8-b586-fdbcfc065b41 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:20.554650 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f37ef0c0-e6bc-4bb8-b586-fdbcfc065b41 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1553 microversion: 2.1 time: 0.213286 Nov 24 15:20:20.562849 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 58/141] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:20 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:20.681874 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6268542c-e3ff-4822-a3af-033756b387e6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:20.688991 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6268542c-e3ff-4822-a3af-033756b387e6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.166769 Nov 24 15:20:20.689662 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 84/142] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:20 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:20.859811 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b0a1af17-6a39-4fba-bdfb-99ce88c16389 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:20.861459 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b0a1af17-6a39-4fba-bdfb-99ce88c16389 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:20.867933 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b0a1af17-6a39-4fba-bdfb-99ce88c16389 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:20.868390 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b0a1af17-6a39-4fba-bdfb-99ce88c16389 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:20.869176 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b0a1af17-6a39-4fba-bdfb-99ce88c16389 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:20.869666 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b0a1af17-6a39-4fba-bdfb-99ce88c16389 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:20.964675 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b0a1af17-6a39-4fba-bdfb-99ce88c16389 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 14 microversion: 2.1 time: 0.109459 Nov 24 15:20:20.966832 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 59/143] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:20 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:20:21.575573 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-75242417-4bdb-4b5c-9229-412d8ff64bac tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:21.576251 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-75242417-4bdb-4b5c-9229-412d8ff64bac tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:21.583677 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-75242417-4bdb-4b5c-9229-412d8ff64bac tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:21.584347 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-75242417-4bdb-4b5c-9229-412d8ff64bac tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:21.585311 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-75242417-4bdb-4b5c-9229-412d8ff64bac tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:21.585785 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-75242417-4bdb-4b5c-9229-412d8ff64bac tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:21.710136 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2a53695d-bbb8-4402-9a3e-bcfaef59cbd0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:21.710899 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2a53695d-bbb8-4402-9a3e-bcfaef59cbd0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:21.723883 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2a53695d-bbb8-4402-9a3e-bcfaef59cbd0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:21.727053 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2a53695d-bbb8-4402-9a3e-bcfaef59cbd0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:21.733532 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2a53695d-bbb8-4402-9a3e-bcfaef59cbd0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:21.734903 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2a53695d-bbb8-4402-9a3e-bcfaef59cbd0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:21.806355 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-75242417-4bdb-4b5c-9229-412d8ff64bac tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:21.815308 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-75242417-4bdb-4b5c-9229-412d8ff64bac tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1553 microversion: 2.1 time: 0.243623 Nov 24 15:20:21.823828 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 85/144] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:21 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:21.923297 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-2a53695d-bbb8-4402-9a3e-bcfaef59cbd0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:21.934862 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2a53695d-bbb8-4402-9a3e-bcfaef59cbd0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.227620 Nov 24 15:20:21.934862 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 60/145] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:21 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:21.975927 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6f3a6e1a-b440-4620-9a5f-e6cfdab11c85 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:21.977529 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6f3a6e1a-b440-4620-9a5f-e6cfdab11c85 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:21.984491 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6f3a6e1a-b440-4620-9a5f-e6cfdab11c85 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:21.985321 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6f3a6e1a-b440-4620-9a5f-e6cfdab11c85 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:21.986792 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6f3a6e1a-b440-4620-9a5f-e6cfdab11c85 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:21.987464 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6f3a6e1a-b440-4620-9a5f-e6cfdab11c85 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:22.833597 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3f8c3af8-8bfc-4c88-bd1f-02d45d980ba1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:22.834273 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3f8c3af8-8bfc-4c88-bd1f-02d45d980ba1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:22.840976 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f8c3af8-8bfc-4c88-bd1f-02d45d980ba1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:22.841420 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f8c3af8-8bfc-4c88-bd1f-02d45d980ba1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:22.842293 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f8c3af8-8bfc-4c88-bd1f-02d45d980ba1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:22.843452 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f8c3af8-8bfc-4c88-bd1f-02d45d980ba1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:22.997624 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-3f8c3af8-8bfc-4c88-bd1f-02d45d980ba1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:23.007041 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3f8c3af8-8bfc-4c88-bd1f-02d45d980ba1 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1553 microversion: 2.1 time: 0.177164 Nov 24 15:20:23.007629 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 61/146] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:22 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:23.011876 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b573c9d0-f6d7-4beb-8656-c75b0690a32b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:23.012480 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b573c9d0-f6d7-4beb-8656-c75b0690a32b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:23.018683 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b573c9d0-f6d7-4beb-8656-c75b0690a32b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:23.019160 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b573c9d0-f6d7-4beb-8656-c75b0690a32b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:23.019943 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b573c9d0-f6d7-4beb-8656-c75b0690a32b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:23.020377 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b573c9d0-f6d7-4beb-8656-c75b0690a32b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:23.192821 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-b573c9d0-f6d7-4beb-8656-c75b0690a32b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:23.200031 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b573c9d0-f6d7-4beb-8656-c75b0690a32b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.191416 Nov 24 15:20:23.200604 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 62/147] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:23 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:24.025410 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6b89b9e4-f640-4229-a2a7-3b75b094a545 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:24.026029 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6b89b9e4-f640-4229-a2a7-3b75b094a545 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:24.032509 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6b89b9e4-f640-4229-a2a7-3b75b094a545 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:24.032963 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6b89b9e4-f640-4229-a2a7-3b75b094a545 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:24.033734 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6b89b9e4-f640-4229-a2a7-3b75b094a545 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:24.034167 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6b89b9e4-f640-4229-a2a7-3b75b094a545 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:24.184386 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6b89b9e4-f640-4229-a2a7-3b75b094a545 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:24.193020 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6b89b9e4-f640-4229-a2a7-3b75b094a545 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1553 microversion: 2.1 time: 0.171205 Nov 24 15:20:24.193842 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 63/148] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:24 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:24.220146 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-31509f35-04c0-4686-b83e-f54ca2a3180d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:24.220985 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-31509f35-04c0-4686-b83e-f54ca2a3180d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:24.227789 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-31509f35-04c0-4686-b83e-f54ca2a3180d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:24.228228 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-31509f35-04c0-4686-b83e-f54ca2a3180d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:24.229018 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-31509f35-04c0-4686-b83e-f54ca2a3180d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:24.229449 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-31509f35-04c0-4686-b83e-f54ca2a3180d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:24.376364 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-31509f35-04c0-4686-b83e-f54ca2a3180d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:24.384092 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-31509f35-04c0-4686-b83e-f54ca2a3180d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.168100 Nov 24 15:20:24.384667 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 64/149] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:24 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:25.209694 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6f3a6e1a-b440-4620-9a5f-e6cfdab11c85 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 14 microversion: 2.1 time: 3.237195 Nov 24 15:20:25.210263 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b5554f36-84de-4e87-9cf7-d9efbd166c92 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:25.210735 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 86/150] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:21 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 14 bytes in 3239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:20:25.212063 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b5554f36-84de-4e87-9cf7-d9efbd166c92 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:25.222015 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b5554f36-84de-4e87-9cf7-d9efbd166c92 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:25.222745 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b5554f36-84de-4e87-9cf7-d9efbd166c92 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:25.224052 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b5554f36-84de-4e87-9cf7-d9efbd166c92 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:25.224749 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b5554f36-84de-4e87-9cf7-d9efbd166c92 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:25.371296 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-b5554f36-84de-4e87-9cf7-d9efbd166c92 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:25.379815 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b5554f36-84de-4e87-9cf7-d9efbd166c92 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1553 microversion: 2.1 time: 0.173741 Nov 24 15:20:25.380602 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 65/151] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:25 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:25.400350 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6988aaa2-118f-4908-ae38-7ea6af0ef9a2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:25.401165 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6988aaa2-118f-4908-ae38-7ea6af0ef9a2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:25.408593 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6988aaa2-118f-4908-ae38-7ea6af0ef9a2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:25.409099 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6988aaa2-118f-4908-ae38-7ea6af0ef9a2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:25.409893 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6988aaa2-118f-4908-ae38-7ea6af0ef9a2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:25.410320 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6988aaa2-118f-4908-ae38-7ea6af0ef9a2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:25.552633 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6988aaa2-118f-4908-ae38-7ea6af0ef9a2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:25.560821 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6988aaa2-118f-4908-ae38-7ea6af0ef9a2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.164144 Nov 24 15:20:25.562459 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 87/152] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:25 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:26.221481 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-74e1e944-b5df-4b79-93f9-4eb42e8646be tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:26.222503 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-74e1e944-b5df-4b79-93f9-4eb42e8646be tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:26.229097 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-74e1e944-b5df-4b79-93f9-4eb42e8646be tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:26.229642 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-74e1e944-b5df-4b79-93f9-4eb42e8646be tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:26.230443 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-74e1e944-b5df-4b79-93f9-4eb42e8646be tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:26.230912 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-74e1e944-b5df-4b79-93f9-4eb42e8646be tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:26.303246 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-74e1e944-b5df-4b79-93f9-4eb42e8646be tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 14 microversion: 2.1 time: 0.085901 Nov 24 15:20:26.303867 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 66/153] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:26 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:20:26.397126 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4c0b2b03-e1cb-4ada-a6b9-537db3c2920d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:26.397749 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4c0b2b03-e1cb-4ada-a6b9-537db3c2920d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:26.404711 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c0b2b03-e1cb-4ada-a6b9-537db3c2920d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:26.405105 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c0b2b03-e1cb-4ada-a6b9-537db3c2920d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:26.406566 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c0b2b03-e1cb-4ada-a6b9-537db3c2920d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:26.407020 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c0b2b03-e1cb-4ada-a6b9-537db3c2920d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:26.492886 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4c0b2b03-e1cb-4ada-a6b9-537db3c2920d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:26.511020 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4c0b2b03-e1cb-4ada-a6b9-537db3c2920d tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1511 microversion: 2.1 time: 0.117444 Nov 24 15:20:26.511775 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 88/154] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:26 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1511 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:26.579565 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4a5d439c-d2cd-4d01-99d5-2f6ae26ca11f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:26.580654 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4a5d439c-d2cd-4d01-99d5-2f6ae26ca11f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:26.595830 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4a5d439c-d2cd-4d01-99d5-2f6ae26ca11f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:26.596468 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4a5d439c-d2cd-4d01-99d5-2f6ae26ca11f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:26.597643 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4a5d439c-d2cd-4d01-99d5-2f6ae26ca11f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:26.598692 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4a5d439c-d2cd-4d01-99d5-2f6ae26ca11f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:26.603001 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-747a75ec-001f-4c9b-9d60-9f30d4174538 req-f02e436e-3244-4e3b-957c-4c3c853ac94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c314c5fb-ef55-4d6a-907d-c67422d61401", "name": "network-vif-deleted", "tag": "4ebc6af1-f8e1-4664-b0bd-51973f886e65"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:26.604519 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:20:26.604519 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:20:26.615912 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-747a75ec-001f-4c9b-9d60-9f30d4174538 req-f02e436e-3244-4e3b-957c-4c3c853ac94c service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:26.616403 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-747a75ec-001f-4c9b-9d60-9f30d4174538 req-f02e436e-3244-4e3b-957c-4c3c853ac94c service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:26.633156 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-747a75ec-001f-4c9b-9d60-9f30d4174538 req-f02e436e-3244-4e3b-957c-4c3c853ac94c service nova] Creating event network-vif-deleted:4ebc6af1-f8e1-4664-b0bd-51973f886e65 for instance c314c5fb-ef55-4d6a-907d-c67422d61401 on hv-cinder-80403 Nov 24 15:20:26.641422 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-747a75ec-001f-4c9b-9d60-9f30d4174538 req-f02e436e-3244-4e3b-957c-4c3c853ac94c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042659 Nov 24 15:20:26.642775 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 89/155] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:20:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:20:26.765428 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4a5d439c-d2cd-4d01-99d5-2f6ae26ca11f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:26.772994 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4a5d439c-d2cd-4d01-99d5-2f6ae26ca11f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.197670 Nov 24 15:20:26.773867 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 67/156] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:26 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:27.316211 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a74145ad-d7bf-4746-8fb0-397e9187132c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:27.317267 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a74145ad-d7bf-4746-8fb0-397e9187132c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:27.323672 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a74145ad-d7bf-4746-8fb0-397e9187132c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:27.324117 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a74145ad-d7bf-4746-8fb0-397e9187132c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:27.324902 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a74145ad-d7bf-4746-8fb0-397e9187132c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:27.325418 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a74145ad-d7bf-4746-8fb0-397e9187132c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:27.435083 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a74145ad-d7bf-4746-8fb0-397e9187132c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 1198 microversion: 2.1 time: 0.123815 Nov 24 15:20:27.438729 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 90/157] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:27 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 1198 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:27.528977 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3fee4e08-4f52-4452-84e6-6cb4e9b9ed1c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:27.529908 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3fee4e08-4f52-4452-84e6-6cb4e9b9ed1c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:27.537086 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3fee4e08-4f52-4452-84e6-6cb4e9b9ed1c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:27.537531 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3fee4e08-4f52-4452-84e6-6cb4e9b9ed1c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:27.538311 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3fee4e08-4f52-4452-84e6-6cb4e9b9ed1c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:27.538736 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3fee4e08-4f52-4452-84e6-6cb4e9b9ed1c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:27.577701 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3fee4e08-4f52-4452-84e6-6cb4e9b9ed1c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:27.578177 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3fee4e08-4f52-4452-84e6-6cb4e9b9ed1c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:27.578675 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-3fee4e08-4f52-4452-84e6-6cb4e9b9ed1c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lazy-loading 'fault' on Instance uuid c314c5fb-ef55-4d6a-907d-c67422d61401 {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:20:27.624572 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-3fee4e08-4f52-4452-84e6-6cb4e9b9ed1c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965237762c1c4340917cb5ddf344ca17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e68438dfae03483f8491309dfb3fbcfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:27.635059 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3fee4e08-4f52-4452-84e6-6cb4e9b9ed1c tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 200 len: 1351 microversion: 2.1 time: 0.110224 Nov 24 15:20:27.635671 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 68/158] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:27 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:27.791750 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a636c313-c430-4c09-9bf5-9f0c12a5105d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:27.792568 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a636c313-c430-4c09-9bf5-9f0c12a5105d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:27.801234 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a636c313-c430-4c09-9bf5-9f0c12a5105d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:27.801434 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a636c313-c430-4c09-9bf5-9f0c12a5105d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:27.802073 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a636c313-c430-4c09-9bf5-9f0c12a5105d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:27.802508 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a636c313-c430-4c09-9bf5-9f0c12a5105d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:27.982208 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a636c313-c430-4c09-9bf5-9f0c12a5105d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:27.992997 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a636c313-c430-4c09-9bf5-9f0c12a5105d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.205184 Nov 24 15:20:27.993788 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 91/159] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:27 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:28.445818 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-fe4fbd03-3bb5-49e2-bb08-5c5374771255 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:28.446781 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-fe4fbd03-3bb5-49e2-bb08-5c5374771255 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:28.453525 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fe4fbd03-3bb5-49e2-bb08-5c5374771255 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:28.454018 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fe4fbd03-3bb5-49e2-bb08-5c5374771255 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:28.454821 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fe4fbd03-3bb5-49e2-bb08-5c5374771255 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:28.455747 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fe4fbd03-3bb5-49e2-bb08-5c5374771255 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:28.534540 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-fe4fbd03-3bb5-49e2-bb08-5c5374771255 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 9137 microversion: 2.1 time: 0.092376 Nov 24 15:20:28.535510 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 69/160] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:28 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 9137 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:28.652824 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fb10248d-84bc-4701-aa6c-0b01f7d15605 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:28.653424 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fb10248d-84bc-4701-aa6c-0b01f7d15605 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:28.660912 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fb10248d-84bc-4701-aa6c-0b01f7d15605 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:28.661697 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fb10248d-84bc-4701-aa6c-0b01f7d15605 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:28.662737 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fb10248d-84bc-4701-aa6c-0b01f7d15605 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:28.663256 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fb10248d-84bc-4701-aa6c-0b01f7d15605 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:28.680155 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-fb10248d-84bc-4701-aa6c-0b01f7d15605 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] HTTP exception thrown: Instance c314c5fb-ef55-4d6a-907d-c67422d61401 could not be found. Nov 24 15:20:28.680780 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fb10248d-84bc-4701-aa6c-0b01f7d15605 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Returning 404 to user: Instance c314c5fb-ef55-4d6a-907d-c67422d61401 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:20:28.681726 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fb10248d-84bc-4701-aa6c-0b01f7d15605 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 404 len: 111 microversion: 2.1 time: 0.033025 Nov 24 15:20:28.682352 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 92/161] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:28 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:20:28.783777 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ab79711a-3661-4692-a352-2e4aa246532e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:28.784791 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ab79711a-3661-4692-a352-2e4aa246532e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:28.791931 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ab79711a-3661-4692-a352-2e4aa246532e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:28.792415 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ab79711a-3661-4692-a352-2e4aa246532e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:28.793197 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ab79711a-3661-4692-a352-2e4aa246532e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:28.793633 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ab79711a-3661-4692-a352-2e4aa246532e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:28.816224 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-ab79711a-3661-4692-a352-2e4aa246532e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] HTTP exception thrown: Instance c314c5fb-ef55-4d6a-907d-c67422d61401 could not be found. Nov 24 15:20:28.816814 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ab79711a-3661-4692-a352-2e4aa246532e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Returning 404 to user: Instance c314c5fb-ef55-4d6a-907d-c67422d61401 could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:20:28.817648 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ab79711a-3661-4692-a352-2e4aa246532e tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037981 Nov 24 15:20:28.818384 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 70/162] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:20:28 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:20:29.009603 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ca832a2a-6720-4036-8f98-9075590efed2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:29.010389 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ca832a2a-6720-4036-8f98-9075590efed2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:29.018390 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ca832a2a-6720-4036-8f98-9075590efed2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:29.018782 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ca832a2a-6720-4036-8f98-9075590efed2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:29.019582 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ca832a2a-6720-4036-8f98-9075590efed2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:29.020043 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ca832a2a-6720-4036-8f98-9075590efed2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:29.151904 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ca832a2a-6720-4036-8f98-9075590efed2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:29.159424 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ca832a2a-6720-4036-8f98-9075590efed2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.153574 Nov 24 15:20:29.159995 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 93/163] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:29 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:29.545687 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6fa9dc23-89c3-4341-8438-bdd2d6c69aaf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:29.547138 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6fa9dc23-89c3-4341-8438-bdd2d6c69aaf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:29.560175 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6fa9dc23-89c3-4341-8438-bdd2d6c69aaf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:29.560574 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6fa9dc23-89c3-4341-8438-bdd2d6c69aaf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:29.561411 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6fa9dc23-89c3-4341-8438-bdd2d6c69aaf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:29.562013 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6fa9dc23-89c3-4341-8438-bdd2d6c69aaf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:30.175350 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-88b91980-0939-42ed-973d-6725d9dbdad4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:30.176025 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-88b91980-0939-42ed-973d-6725d9dbdad4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:30.182081 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-88b91980-0939-42ed-973d-6725d9dbdad4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:30.182526 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-88b91980-0939-42ed-973d-6725d9dbdad4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:30.183322 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-88b91980-0939-42ed-973d-6725d9dbdad4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:30.183748 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-88b91980-0939-42ed-973d-6725d9dbdad4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:30.327618 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-88b91980-0939-42ed-973d-6725d9dbdad4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:30.335285 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-88b91980-0939-42ed-973d-6725d9dbdad4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.163464 Nov 24 15:20:30.335853 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 94/164] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:30 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:31.352094 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e5e8f5cd-83b0-4fae-9d4a-78622931b5f8 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:31.352684 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e5e8f5cd-83b0-4fae-9d4a-78622931b5f8 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:31.358925 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e5e8f5cd-83b0-4fae-9d4a-78622931b5f8 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:31.359371 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e5e8f5cd-83b0-4fae-9d4a-78622931b5f8 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:31.360139 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e5e8f5cd-83b0-4fae-9d4a-78622931b5f8 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:31.360572 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e5e8f5cd-83b0-4fae-9d4a-78622931b5f8 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:31.487829 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e5e8f5cd-83b0-4fae-9d4a-78622931b5f8 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:31.495364 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e5e8f5cd-83b0-4fae-9d4a-78622931b5f8 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.146955 Nov 24 15:20:31.495927 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 95/165] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:31 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:32.175395 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6fa9dc23-89c3-4341-8438-bdd2d6c69aaf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 19342 microversion: 2.1 time: 2.633298 Nov 24 15:20:32.176089 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 71/166] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:29 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 19342 bytes in 2635 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:32.512104 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9ee2284b-0e9b-4076-9721-ef79dd71b5fc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:32.512756 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9ee2284b-0e9b-4076-9721-ef79dd71b5fc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:32.519312 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ee2284b-0e9b-4076-9721-ef79dd71b5fc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:32.519754 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ee2284b-0e9b-4076-9721-ef79dd71b5fc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:32.520523 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ee2284b-0e9b-4076-9721-ef79dd71b5fc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:32.520950 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ee2284b-0e9b-4076-9721-ef79dd71b5fc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:32.659011 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9ee2284b-0e9b-4076-9721-ef79dd71b5fc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:32.666636 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9ee2284b-0e9b-4076-9721-ef79dd71b5fc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.158754 Nov 24 15:20:32.667437 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 96/167] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:32 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:33.189581 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-e6253ec5-8637-4303-ba93-1a12568689b5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:33.191342 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-e6253ec5-8637-4303-ba93-1a12568689b5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:33.210603 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e6253ec5-8637-4303-ba93-1a12568689b5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:33.211179 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e6253ec5-8637-4303-ba93-1a12568689b5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:33.212141 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e6253ec5-8637-4303-ba93-1a12568689b5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:33.213910 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e6253ec5-8637-4303-ba93-1a12568689b5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:33.302618 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-e6253ec5-8637-4303-ba93-1a12568689b5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 21570 microversion: 2.1 time: 0.119231 Nov 24 15:20:33.304033 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 72/168] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:33 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 21570 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:33.335447 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8f85765a-b31b-490d-85f2-14dc42776f89 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:33.336072 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8f85765a-b31b-490d-85f2-14dc42776f89 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:33.343404 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8f85765a-b31b-490d-85f2-14dc42776f89 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:33.343851 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8f85765a-b31b-490d-85f2-14dc42776f89 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:33.344632 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8f85765a-b31b-490d-85f2-14dc42776f89 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:33.345066 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8f85765a-b31b-490d-85f2-14dc42776f89 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:33.361942 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-8f85765a-b31b-490d-85f2-14dc42776f89 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] HTTP exception thrown: Instance c314c5fb-ef55-4d6a-907d-c67422d61401 could not be found. Nov 24 15:20:33.362592 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8f85765a-b31b-490d-85f2-14dc42776f89 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Returning 404 to user: Instance c314c5fb-ef55-4d6a-907d-c67422d61401 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:20:33.363494 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8f85765a-b31b-490d-85f2-14dc42776f89 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 404 len: 111 microversion: 2.1 time: 0.032189 Nov 24 15:20:33.363972 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 97/169] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:20:33 2021] DELETE /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:20:33.377065 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-de1359ad-11f6-47cc-a6e5-838a2d1e2407 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:33.378530 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-de1359ad-11f6-47cc-a6e5-838a2d1e2407 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] [instance: c314c5fb-ef55-4d6a-907d-c67422d61401] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:33.393552 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-de1359ad-11f6-47cc-a6e5-838a2d1e2407 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:33.394001 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-de1359ad-11f6-47cc-a6e5-838a2d1e2407 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:33.394783 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-de1359ad-11f6-47cc-a6e5-838a2d1e2407 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:33.395245 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-de1359ad-11f6-47cc-a6e5-838a2d1e2407 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:33.409414 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-de1359ad-11f6-47cc-a6e5-838a2d1e2407 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] HTTP exception thrown: Instance c314c5fb-ef55-4d6a-907d-c67422d61401 could not be found. Nov 24 15:20:33.409994 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-de1359ad-11f6-47cc-a6e5-838a2d1e2407 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] Returning 404 to user: Instance c314c5fb-ef55-4d6a-907d-c67422d61401 could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:20:33.410800 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-de1359ad-11f6-47cc-a6e5-838a2d1e2407 tempest-DeleteServersTestJSON-1708614859 tempest-DeleteServersTestJSON-1708614859-project] 10.222.0.66 "GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401" status: 404 len: 111 microversion: 2.1 time: 0.037793 Nov 24 15:20:33.411352 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 73/170] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:33 2021] GET /compute/v2.1/servers/c314c5fb-ef55-4d6a-907d-c67422d61401 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:20:33.685291 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a5a3e5bb-c1b2-4e57-8538-125ae29b0ab1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:33.686012 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a5a3e5bb-c1b2-4e57-8538-125ae29b0ab1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:33.694542 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a5a3e5bb-c1b2-4e57-8538-125ae29b0ab1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:33.695571 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a5a3e5bb-c1b2-4e57-8538-125ae29b0ab1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:33.695987 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a5a3e5bb-c1b2-4e57-8538-125ae29b0ab1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:33.696520 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a5a3e5bb-c1b2-4e57-8538-125ae29b0ab1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:33.940147 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a5a3e5bb-c1b2-4e57-8538-125ae29b0ab1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:33.947543 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a5a3e5bb-c1b2-4e57-8538-125ae29b0ab1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.266242 Nov 24 15:20:33.948111 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 98/171] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:33 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:34.315301 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-70367cde-8ba1-426c-ba03-e9856bda2907 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:34.315968 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-70367cde-8ba1-426c-ba03-e9856bda2907 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:34.322061 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-70367cde-8ba1-426c-ba03-e9856bda2907 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:34.322513 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-70367cde-8ba1-426c-ba03-e9856bda2907 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:34.323329 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-70367cde-8ba1-426c-ba03-e9856bda2907 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:34.323764 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-70367cde-8ba1-426c-ba03-e9856bda2907 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:34.965455 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4716453b-d8f9-469a-b05a-239685cd8f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:34.966169 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4716453b-d8f9-469a-b05a-239685cd8f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:34.973169 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4716453b-d8f9-469a-b05a-239685cd8f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:34.973706 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4716453b-d8f9-469a-b05a-239685cd8f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:34.974545 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4716453b-d8f9-469a-b05a-239685cd8f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:34.975099 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4716453b-d8f9-469a-b05a-239685cd8f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:35.112935 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4716453b-d8f9-469a-b05a-239685cd8f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:35.120878 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4716453b-d8f9-469a-b05a-239685cd8f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.159604 Nov 24 15:20:35.121525 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 99/172] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:34 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:36.137384 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7081064e-7ed7-4246-9635-a85bee0212d3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:36.138035 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7081064e-7ed7-4246-9635-a85bee0212d3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:36.144817 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7081064e-7ed7-4246-9635-a85bee0212d3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:36.145257 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7081064e-7ed7-4246-9635-a85bee0212d3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:36.146032 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7081064e-7ed7-4246-9635-a85bee0212d3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:36.146471 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7081064e-7ed7-4246-9635-a85bee0212d3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:36.275873 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7081064e-7ed7-4246-9635-a85bee0212d3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:36.283169 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7081064e-7ed7-4246-9635-a85bee0212d3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.149419 Nov 24 15:20:36.283788 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 100/173] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:36 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:36.714183 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-70367cde-8ba1-426c-ba03-e9856bda2907 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 25596 microversion: 2.1 time: 2.403089 Nov 24 15:20:36.715087 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 74/174] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:34 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 25596 bytes in 2405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:37.299761 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-36514316-6cd7-470c-a38d-12998407d279 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:37.300719 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-36514316-6cd7-470c-a38d-12998407d279 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:37.307673 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-36514316-6cd7-470c-a38d-12998407d279 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:37.308127 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-36514316-6cd7-470c-a38d-12998407d279 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:37.308917 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-36514316-6cd7-470c-a38d-12998407d279 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:37.309357 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-36514316-6cd7-470c-a38d-12998407d279 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:37.457481 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-36514316-6cd7-470c-a38d-12998407d279 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:37.466747 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-36514316-6cd7-470c-a38d-12998407d279 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.171095 Nov 24 15:20:37.468304 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 101/175] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:37 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:37.726381 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3fb7ff78-dc90-4fd5-9c7c-9481aaec816d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:37.727405 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3fb7ff78-dc90-4fd5-9c7c-9481aaec816d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:37.735249 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3fb7ff78-dc90-4fd5-9c7c-9481aaec816d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:37.735789 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3fb7ff78-dc90-4fd5-9c7c-9481aaec816d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:37.736476 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3fb7ff78-dc90-4fd5-9c7c-9481aaec816d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:37.736902 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3fb7ff78-dc90-4fd5-9c7c-9481aaec816d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:38.484601 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a50f01d6-4c7f-48d7-9f09-b3bf06bad47f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:38.485204 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a50f01d6-4c7f-48d7-9f09-b3bf06bad47f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:38.491737 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a50f01d6-4c7f-48d7-9f09-b3bf06bad47f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:38.492186 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a50f01d6-4c7f-48d7-9f09-b3bf06bad47f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:38.492983 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a50f01d6-4c7f-48d7-9f09-b3bf06bad47f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:38.493420 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a50f01d6-4c7f-48d7-9f09-b3bf06bad47f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:38.626780 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a50f01d6-4c7f-48d7-9f09-b3bf06bad47f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:38.635466 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a50f01d6-4c7f-48d7-9f09-b3bf06bad47f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.155015 Nov 24 15:20:38.636023 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 102/176] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:38 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:39.652178 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-69e42603-c896-4f18-9adb-3f29e56b7d37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:39.652790 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-69e42603-c896-4f18-9adb-3f29e56b7d37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:39.659651 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69e42603-c896-4f18-9adb-3f29e56b7d37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:39.661148 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69e42603-c896-4f18-9adb-3f29e56b7d37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:39.662312 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69e42603-c896-4f18-9adb-3f29e56b7d37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:39.662465 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69e42603-c896-4f18-9adb-3f29e56b7d37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:39.791296 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-69e42603-c896-4f18-9adb-3f29e56b7d37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:39.798876 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-69e42603-c896-4f18-9adb-3f29e56b7d37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.150198 Nov 24 15:20:39.799459 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 103/177] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:39 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:40.177824 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3fb7ff78-dc90-4fd5-9c7c-9481aaec816d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 27545 microversion: 2.1 time: 2.455287 Nov 24 15:20:40.178784 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 75/178] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:37 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 27545 bytes in 2457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:40.816229 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ab704ed5-fa6f-4169-a48a-e1f2bb237ca4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:40.817648 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ab704ed5-fa6f-4169-a48a-e1f2bb237ca4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:40.825491 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ab704ed5-fa6f-4169-a48a-e1f2bb237ca4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:40.826248 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ab704ed5-fa6f-4169-a48a-e1f2bb237ca4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:40.827378 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ab704ed5-fa6f-4169-a48a-e1f2bb237ca4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:40.828385 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ab704ed5-fa6f-4169-a48a-e1f2bb237ca4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:41.000739 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ab704ed5-fa6f-4169-a48a-e1f2bb237ca4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:41.009350 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ab704ed5-fa6f-4169-a48a-e1f2bb237ca4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.196791 Nov 24 15:20:41.019494 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 104/179] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:40 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:41.194009 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ebe28668-2c6c-435a-8ea6-c8c77f0198a9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:41.195044 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ebe28668-2c6c-435a-8ea6-c8c77f0198a9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:41.204250 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebe28668-2c6c-435a-8ea6-c8c77f0198a9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:41.204705 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebe28668-2c6c-435a-8ea6-c8c77f0198a9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:41.205529 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebe28668-2c6c-435a-8ea6-c8c77f0198a9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:41.205939 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebe28668-2c6c-435a-8ea6-c8c77f0198a9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:41.296179 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ebe28668-2c6c-435a-8ea6-c8c77f0198a9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 27749 microversion: 2.1 time: 0.105930 Nov 24 15:20:41.297310 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 76/180] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:41 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 27749 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:42.026978 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a8aa26ff-b721-4d32-b329-2c83af0a1415 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:42.027482 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a8aa26ff-b721-4d32-b329-2c83af0a1415 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:42.033900 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a8aa26ff-b721-4d32-b329-2c83af0a1415 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:42.034335 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a8aa26ff-b721-4d32-b329-2c83af0a1415 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:42.035130 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a8aa26ff-b721-4d32-b329-2c83af0a1415 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:42.035557 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a8aa26ff-b721-4d32-b329-2c83af0a1415 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:42.161519 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a8aa26ff-b721-4d32-b329-2c83af0a1415 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:42.176054 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a8aa26ff-b721-4d32-b329-2c83af0a1415 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.152819 Nov 24 15:20:42.176749 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 105/181] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:42 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:42.308723 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-7454236d-00d8-47d2-9ea0-760640678c10 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:42.309653 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-7454236d-00d8-47d2-9ea0-760640678c10 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:42.316540 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7454236d-00d8-47d2-9ea0-760640678c10 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:42.316986 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7454236d-00d8-47d2-9ea0-760640678c10 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:42.317758 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7454236d-00d8-47d2-9ea0-760640678c10 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:42.318192 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7454236d-00d8-47d2-9ea0-760640678c10 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:43.192799 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2fd6e14b-124d-4d67-96bb-b9286d583a69 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:43.193396 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2fd6e14b-124d-4d67-96bb-b9286d583a69 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:43.199612 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2fd6e14b-124d-4d67-96bb-b9286d583a69 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:43.200054 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2fd6e14b-124d-4d67-96bb-b9286d583a69 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:43.200847 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2fd6e14b-124d-4d67-96bb-b9286d583a69 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:43.201276 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2fd6e14b-124d-4d67-96bb-b9286d583a69 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:43.332432 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2fd6e14b-124d-4d67-96bb-b9286d583a69 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:43.339627 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2fd6e14b-124d-4d67-96bb-b9286d583a69 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.150455 Nov 24 15:20:43.340184 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 106/182] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:43 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:44.269219 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-7454236d-00d8-47d2-9ea0-760640678c10 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 27860 microversion: 2.1 time: 1.964379 Nov 24 15:20:44.269891 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 77/183] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:42 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 27860 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:20:44.356123 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-97ea1b89-0a4d-4c3e-998a-597c30955474 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:44.356731 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-97ea1b89-0a4d-4c3e-998a-597c30955474 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:44.363122 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97ea1b89-0a4d-4c3e-998a-597c30955474 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:44.363502 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97ea1b89-0a4d-4c3e-998a-597c30955474 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:44.364534 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97ea1b89-0a4d-4c3e-998a-597c30955474 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:44.364967 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-97ea1b89-0a4d-4c3e-998a-597c30955474 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:44.495613 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-97ea1b89-0a4d-4c3e-998a-597c30955474 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:44.504544 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-97ea1b89-0a4d-4c3e-998a-597c30955474 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.151999 Nov 24 15:20:44.505080 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 107/184] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:44 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:45.281930 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2c64b947-dddd-4013-9d28-65cc36578041 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:45.283426 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2c64b947-dddd-4013-9d28-65cc36578041 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:45.292815 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2c64b947-dddd-4013-9d28-65cc36578041 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:45.293260 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2c64b947-dddd-4013-9d28-65cc36578041 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:45.294033 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2c64b947-dddd-4013-9d28-65cc36578041 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:45.294577 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2c64b947-dddd-4013-9d28-65cc36578041 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:45.378647 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2c64b947-dddd-4013-9d28-65cc36578041 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 28154 microversion: 2.1 time: 0.101250 Nov 24 15:20:45.379387 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 78/185] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:45 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 28154 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:45.520951 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8e06202a-8217-4655-b2ad-0f0b68f5169b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:45.521540 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8e06202a-8217-4655-b2ad-0f0b68f5169b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:45.528225 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e06202a-8217-4655-b2ad-0f0b68f5169b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:45.528896 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e06202a-8217-4655-b2ad-0f0b68f5169b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:45.530358 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e06202a-8217-4655-b2ad-0f0b68f5169b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:45.530974 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8e06202a-8217-4655-b2ad-0f0b68f5169b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:45.695353 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8e06202a-8217-4655-b2ad-0f0b68f5169b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:45.703426 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8e06202a-8217-4655-b2ad-0f0b68f5169b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.185972 Nov 24 15:20:45.712953 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 108/186] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:45 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:46.390614 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-e1d28acb-b811-4aa1-bae0-fe98035e4084 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:46.391725 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-e1d28acb-b811-4aa1-bae0-fe98035e4084 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:46.398462 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e1d28acb-b811-4aa1-bae0-fe98035e4084 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:46.398935 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e1d28acb-b811-4aa1-bae0-fe98035e4084 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:46.399705 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e1d28acb-b811-4aa1-bae0-fe98035e4084 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:46.400130 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e1d28acb-b811-4aa1-bae0-fe98035e4084 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:46.470036 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-e1d28acb-b811-4aa1-bae0-fe98035e4084 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 28154 microversion: 2.1 time: 0.083148 Nov 24 15:20:46.470616 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 79/187] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:46 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 28154 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:46.720615 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7b891422-413b-4007-9793-8067343f2b50 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:46.721186 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7b891422-413b-4007-9793-8067343f2b50 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:46.727267 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7b891422-413b-4007-9793-8067343f2b50 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:46.727714 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7b891422-413b-4007-9793-8067343f2b50 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:46.728486 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7b891422-413b-4007-9793-8067343f2b50 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:46.728916 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7b891422-413b-4007-9793-8067343f2b50 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:46.861429 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7b891422-413b-4007-9793-8067343f2b50 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:46.869623 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7b891422-413b-4007-9793-8067343f2b50 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.152978 Nov 24 15:20:46.870992 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 109/188] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:46 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:47.486336 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6f576b15-fe35-4841-9eb9-df1faae5f2cc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:47.488226 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6f576b15-fe35-4841-9eb9-df1faae5f2cc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:47.501093 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6f576b15-fe35-4841-9eb9-df1faae5f2cc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:47.501993 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6f576b15-fe35-4841-9eb9-df1faae5f2cc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:47.503862 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6f576b15-fe35-4841-9eb9-df1faae5f2cc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:47.504594 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6f576b15-fe35-4841-9eb9-df1faae5f2cc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:47.609134 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6f576b15-fe35-4841-9eb9-df1faae5f2cc tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 28445 microversion: 2.1 time: 0.128319 Nov 24 15:20:47.616660 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 80/189] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:47 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 28445 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:47.890100 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-70e2ba8d-bb62-422d-a709-676a12facff9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:47.891642 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-70e2ba8d-bb62-422d-a709-676a12facff9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:47.898670 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70e2ba8d-bb62-422d-a709-676a12facff9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:47.902074 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70e2ba8d-bb62-422d-a709-676a12facff9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:47.903177 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70e2ba8d-bb62-422d-a709-676a12facff9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:47.904858 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-70e2ba8d-bb62-422d-a709-676a12facff9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:48.148848 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-70e2ba8d-bb62-422d-a709-676a12facff9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:48.156873 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-70e2ba8d-bb62-422d-a709-676a12facff9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.272736 Nov 24 15:20:48.157561 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 110/190] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:47 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:48.622497 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b5fa4ea5-d0bb-4fb3-b2d3-a93f274c3fa5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:48.623500 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b5fa4ea5-d0bb-4fb3-b2d3-a93f274c3fa5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:48.630261 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b5fa4ea5-d0bb-4fb3-b2d3-a93f274c3fa5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:48.630702 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b5fa4ea5-d0bb-4fb3-b2d3-a93f274c3fa5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:48.631506 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b5fa4ea5-d0bb-4fb3-b2d3-a93f274c3fa5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:48.631996 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b5fa4ea5-d0bb-4fb3-b2d3-a93f274c3fa5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:49.175023 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5c877087-4967-4644-89ea-21195a7d51df tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:49.176676 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5c877087-4967-4644-89ea-21195a7d51df tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:49.184193 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5c877087-4967-4644-89ea-21195a7d51df tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:49.184639 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5c877087-4967-4644-89ea-21195a7d51df tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:49.186401 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5c877087-4967-4644-89ea-21195a7d51df tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:49.187035 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5c877087-4967-4644-89ea-21195a7d51df tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:49.394225 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5c877087-4967-4644-89ea-21195a7d51df tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:49.402180 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5c877087-4967-4644-89ea-21195a7d51df tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.231938 Nov 24 15:20:49.413244 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 111/191] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:49 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:50.422843 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1be6cb9c-6ecd-4a5c-9912-846c8a00c203 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:50.424427 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1be6cb9c-6ecd-4a5c-9912-846c8a00c203 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:50.446562 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1be6cb9c-6ecd-4a5c-9912-846c8a00c203 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:50.447091 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1be6cb9c-6ecd-4a5c-9912-846c8a00c203 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:50.447905 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1be6cb9c-6ecd-4a5c-9912-846c8a00c203 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:50.448332 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1be6cb9c-6ecd-4a5c-9912-846c8a00c203 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:51.011269 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b5fa4ea5-d0bb-4fb3-b2d3-a93f274c3fa5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 28445 microversion: 2.1 time: 2.390755 Nov 24 15:20:51.013098 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 81/192] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:48 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 28445 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:51.016733 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1be6cb9c-6ecd-4a5c-9912-846c8a00c203 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:51.025509 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1be6cb9c-6ecd-4a5c-9912-846c8a00c203 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.609484 Nov 24 15:20:51.028662 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 112/193] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:50 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:52.024063 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-62466b80-1ef3-411a-b757-72182a3a2454 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:52.025930 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-62466b80-1ef3-411a-b757-72182a3a2454 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:52.043773 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-62466b80-1ef3-411a-b757-72182a3a2454 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:52.044573 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-62466b80-1ef3-411a-b757-72182a3a2454 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:52.046360 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-62466b80-1ef3-411a-b757-72182a3a2454 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:52.047200 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-62466b80-1ef3-411a-b757-72182a3a2454 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:52.054561 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-be2ede10-ac17-4f6e-9420-63ce794ce3e5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:52.057108 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-be2ede10-ac17-4f6e-9420-63ce794ce3e5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:52.086470 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-be2ede10-ac17-4f6e-9420-63ce794ce3e5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:52.087107 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-be2ede10-ac17-4f6e-9420-63ce794ce3e5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:52.088296 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-be2ede10-ac17-4f6e-9420-63ce794ce3e5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:52.089781 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-be2ede10-ac17-4f6e-9420-63ce794ce3e5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:52.136247 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-62466b80-1ef3-411a-b757-72182a3a2454 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 28613 microversion: 2.1 time: 0.116061 Nov 24 15:20:52.138402 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 82/194] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:52 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 28613 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:52.358894 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-be2ede10-ac17-4f6e-9420-63ce794ce3e5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:52.378296 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-be2ede10-ac17-4f6e-9420-63ce794ce3e5 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.337105 Nov 24 15:20:52.379875 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 113/195] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:52 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:53.150466 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-eeb8527c-2f7a-4513-b5d8-738f43e5d630 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:53.152475 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-eeb8527c-2f7a-4513-b5d8-738f43e5d630 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:53.183121 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eeb8527c-2f7a-4513-b5d8-738f43e5d630 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:53.183511 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eeb8527c-2f7a-4513-b5d8-738f43e5d630 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:53.184319 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eeb8527c-2f7a-4513-b5d8-738f43e5d630 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:53.184756 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eeb8527c-2f7a-4513-b5d8-738f43e5d630 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:53.284776 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-eeb8527c-2f7a-4513-b5d8-738f43e5d630 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 28613 microversion: 2.1 time: 0.139659 Nov 24 15:20:53.285428 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 83/196] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:53 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 28613 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:53.396324 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5249ea5c-5984-4896-b3bc-998ca3e28b7a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:53.397568 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5249ea5c-5984-4896-b3bc-998ca3e28b7a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:53.409417 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5249ea5c-5984-4896-b3bc-998ca3e28b7a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:53.411044 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5249ea5c-5984-4896-b3bc-998ca3e28b7a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:53.412402 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5249ea5c-5984-4896-b3bc-998ca3e28b7a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:53.413807 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5249ea5c-5984-4896-b3bc-998ca3e28b7a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:53.664225 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5249ea5c-5984-4896-b3bc-998ca3e28b7a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:53.675912 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5249ea5c-5984-4896-b3bc-998ca3e28b7a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.283564 Nov 24 15:20:53.676507 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 114/197] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:53 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:54.302682 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a258b7a2-9ddd-47bf-9d6b-467f6fe033c7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:54.304173 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a258b7a2-9ddd-47bf-9d6b-467f6fe033c7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:54.312069 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a258b7a2-9ddd-47bf-9d6b-467f6fe033c7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:54.312519 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a258b7a2-9ddd-47bf-9d6b-467f6fe033c7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:54.313438 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a258b7a2-9ddd-47bf-9d6b-467f6fe033c7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:54.313875 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a258b7a2-9ddd-47bf-9d6b-467f6fe033c7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:54.389753 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a258b7a2-9ddd-47bf-9d6b-467f6fe033c7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 28613 microversion: 2.1 time: 0.092215 Nov 24 15:20:54.390472 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 84/198] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:54 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 28613 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:54.694328 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0162f593-0f38-4674-8d1a-eb02a3044a34 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:54.696030 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0162f593-0f38-4674-8d1a-eb02a3044a34 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:54.713120 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0162f593-0f38-4674-8d1a-eb02a3044a34 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:54.714045 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0162f593-0f38-4674-8d1a-eb02a3044a34 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:54.721551 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0162f593-0f38-4674-8d1a-eb02a3044a34 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:54.722438 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0162f593-0f38-4674-8d1a-eb02a3044a34 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:55.064248 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0162f593-0f38-4674-8d1a-eb02a3044a34 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:55.072348 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0162f593-0f38-4674-8d1a-eb02a3044a34 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.383415 Nov 24 15:20:55.073067 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 115/199] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:54 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:55.402823 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-0a807412-df57-4934-8217-f20f069f81a7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:55.406758 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-0a807412-df57-4934-8217-f20f069f81a7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:55.427455 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0a807412-df57-4934-8217-f20f069f81a7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:55.428205 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0a807412-df57-4934-8217-f20f069f81a7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:55.429370 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0a807412-df57-4934-8217-f20f069f81a7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:55.429960 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0a807412-df57-4934-8217-f20f069f81a7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:55.524041 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-0a807412-df57-4934-8217-f20f069f81a7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 28613 microversion: 2.1 time: 0.125861 Nov 24 15:20:55.525162 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 85/200] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:55 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 28613 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:56.091208 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4da84d81-e7be-4486-b743-12a4bd5a4250 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:56.092030 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4da84d81-e7be-4486-b743-12a4bd5a4250 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:56.102963 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4da84d81-e7be-4486-b743-12a4bd5a4250 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:56.103271 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4da84d81-e7be-4486-b743-12a4bd5a4250 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:56.104084 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4da84d81-e7be-4486-b743-12a4bd5a4250 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:56.108874 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4da84d81-e7be-4486-b743-12a4bd5a4250 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:56.310220 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4da84d81-e7be-4486-b743-12a4bd5a4250 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:56.323214 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4da84d81-e7be-4486-b743-12a4bd5a4250 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.232984 Nov 24 15:20:56.329298 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 116/201] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:56 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:20:56.537728 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-7ff83e18-1778-43d2-a66b-24d834edf68e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:56.539354 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-7ff83e18-1778-43d2-a66b-24d834edf68e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:56.557413 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7ff83e18-1778-43d2-a66b-24d834edf68e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:56.558055 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7ff83e18-1778-43d2-a66b-24d834edf68e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:56.559047 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7ff83e18-1778-43d2-a66b-24d834edf68e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:56.559634 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7ff83e18-1778-43d2-a66b-24d834edf68e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:56.679200 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-7ff83e18-1778-43d2-a66b-24d834edf68e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 30344 microversion: 2.1 time: 0.144658 Nov 24 15:20:56.680667 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 86/202] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:56 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 30344 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:57.344778 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-966475b9-98a7-4b75-81e8-8dca01a3be08 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:57.346259 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-966475b9-98a7-4b75-81e8-8dca01a3be08 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:57.364528 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-966475b9-98a7-4b75-81e8-8dca01a3be08 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:57.365406 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-966475b9-98a7-4b75-81e8-8dca01a3be08 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:57.368889 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-966475b9-98a7-4b75-81e8-8dca01a3be08 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:57.370025 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-966475b9-98a7-4b75-81e8-8dca01a3be08 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:57.691518 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a1573e42-ba48-4edc-895b-04ff0297a6ca tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:57.693194 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a1573e42-ba48-4edc-895b-04ff0297a6ca tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:57.714927 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a1573e42-ba48-4edc-895b-04ff0297a6ca tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:57.715472 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a1573e42-ba48-4edc-895b-04ff0297a6ca tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:57.716337 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a1573e42-ba48-4edc-895b-04ff0297a6ca tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:57.720650 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a1573e42-ba48-4edc-895b-04ff0297a6ca tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:57.752633 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-966475b9-98a7-4b75-81e8-8dca01a3be08 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:57.765950 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-966475b9-98a7-4b75-81e8-8dca01a3be08 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.428298 Nov 24 15:20:57.766946 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 117/203] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:57 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:20:57.817819 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a1573e42-ba48-4edc-895b-04ff0297a6ca tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 31953 microversion: 2.1 time: 0.131026 Nov 24 15:20:57.818959 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 87/204] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:57 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 31953 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:58.785331 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c4520381-1836-4d0f-b132-34f72e02e809 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:20:58.786501 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c4520381-1836-4d0f-b132-34f72e02e809 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:58.792626 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c4520381-1836-4d0f-b132-34f72e02e809 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:58.793081 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c4520381-1836-4d0f-b132-34f72e02e809 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:58.793876 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c4520381-1836-4d0f-b132-34f72e02e809 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:58.794309 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c4520381-1836-4d0f-b132-34f72e02e809 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:58.830532 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-572c3888-0531-446c-988e-817904929a57 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:20:58.832517 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-572c3888-0531-446c-988e-817904929a57 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:20:58.847769 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-572c3888-0531-446c-988e-817904929a57 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:58.856608 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-572c3888-0531-446c-988e-817904929a57 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:58.859061 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-572c3888-0531-446c-988e-817904929a57 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:20:58.860136 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-572c3888-0531-446c-988e-817904929a57 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:20:59.023919 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-572c3888-0531-446c-988e-817904929a57 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 33231 microversion: 2.1 time: 0.197330 Nov 24 15:20:59.025290 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 88/205] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:20:58 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 33231 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:20:59.403872 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c4520381-1836-4d0f-b132-34f72e02e809 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:20:59.432622 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c4520381-1836-4d0f-b132-34f72e02e809 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.650773 Nov 24 15:20:59.455389 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 118/206] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:20:58 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:00.037212 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-dfc3c61c-95e6-4a42-973e-aee90400f0e3 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:00.038589 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-dfc3c61c-95e6-4a42-973e-aee90400f0e3 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:00.057593 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dfc3c61c-95e6-4a42-973e-aee90400f0e3 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:00.057907 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dfc3c61c-95e6-4a42-973e-aee90400f0e3 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:00.061473 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dfc3c61c-95e6-4a42-973e-aee90400f0e3 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:00.063203 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dfc3c61c-95e6-4a42-973e-aee90400f0e3 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:00.215891 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-dfc3c61c-95e6-4a42-973e-aee90400f0e3 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 33963 microversion: 2.1 time: 0.182701 Nov 24 15:21:00.216792 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 89/207] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:21:00 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 33963 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:21:00.477322 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3cb4a771-f0f3-4e93-91b3-093c614d225c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:00.478010 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3cb4a771-f0f3-4e93-91b3-093c614d225c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:00.506146 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cb4a771-f0f3-4e93-91b3-093c614d225c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:00.508095 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cb4a771-f0f3-4e93-91b3-093c614d225c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:00.512550 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cb4a771-f0f3-4e93-91b3-093c614d225c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:00.514475 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cb4a771-f0f3-4e93-91b3-093c614d225c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:00.921949 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3cb4a771-f0f3-4e93-91b3-093c614d225c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:00.939401 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3cb4a771-f0f3-4e93-91b3-093c614d225c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1521 microversion: 2.1 time: 0.473545 Nov 24 15:21:00.941219 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 119/208] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:00 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:01.229691 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a109cb33-0a26-4647-b478-94cbb7d34554 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:01.230924 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a109cb33-0a26-4647-b478-94cbb7d34554 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:01.252239 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a109cb33-0a26-4647-b478-94cbb7d34554 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:01.253040 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a109cb33-0a26-4647-b478-94cbb7d34554 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:01.258242 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a109cb33-0a26-4647-b478-94cbb7d34554 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:01.260577 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a109cb33-0a26-4647-b478-94cbb7d34554 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:01.399535 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a109cb33-0a26-4647-b478-94cbb7d34554 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 34503 microversion: 2.1 time: 0.173718 Nov 24 15:21:01.400420 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 90/209] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:21:01 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 34503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:21:01.958511 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2693829a-2d94-446d-8aa9-20e5fe502056 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:01.959300 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2693829a-2d94-446d-8aa9-20e5fe502056 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:01.981015 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2693829a-2d94-446d-8aa9-20e5fe502056 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:01.981015 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2693829a-2d94-446d-8aa9-20e5fe502056 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:01.981739 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2693829a-2d94-446d-8aa9-20e5fe502056 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:01.982220 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2693829a-2d94-446d-8aa9-20e5fe502056 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:02.349695 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2693829a-2d94-446d-8aa9-20e5fe502056 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:02.358409 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2693829a-2d94-446d-8aa9-20e5fe502056 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1501 microversion: 2.1 time: 0.404462 Nov 24 15:21:02.359012 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 120/210] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:01 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1501 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:02.378432 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ce63abbd-8a80-47ee-928b-cadba1544192 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:02.379847 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ce63abbd-8a80-47ee-928b-cadba1544192 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:02.402899 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ce63abbd-8a80-47ee-928b-cadba1544192 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:02.406373 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ce63abbd-8a80-47ee-928b-cadba1544192 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:02.410291 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ce63abbd-8a80-47ee-928b-cadba1544192 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:02.411757 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ce63abbd-8a80-47ee-928b-cadba1544192 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:02.412110 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7f104f76-8a61-44bd-8042-7da2f74781e9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:02.413241 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7f104f76-8a61-44bd-8042-7da2f74781e9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:02.424006 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f104f76-8a61-44bd-8042-7da2f74781e9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:02.425090 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f104f76-8a61-44bd-8042-7da2f74781e9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:02.426465 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f104f76-8a61-44bd-8042-7da2f74781e9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:02.426941 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f104f76-8a61-44bd-8042-7da2f74781e9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:02.539052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7f104f76-8a61-44bd-8042-7da2f74781e9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 35150 microversion: 2.1 time: 0.131142 Nov 24 15:21:02.540382 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 121/211] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:21:02 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 35150 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:21:02.658492 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ce63abbd-8a80-47ee-928b-cadba1544192 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:02.666082 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ce63abbd-8a80-47ee-928b-cadba1544192 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1516 microversion: 2.1 time: 0.291521 Nov 24 15:21:02.667003 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 91/212] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:02 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1516 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:02.846569 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6719c2bc-c22e-4df4-aaba-c1b2e91408e3 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Action: 'create', calling method: .version_select at 0x7f930cd42430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1044302524"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:02.881660 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-6719c2bc-c22e-4df4-aaba-c1b2e91408e3 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Getting quotas for project b981a3c2d7974c7ca0c54a5262ea5220. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:21:02.887124 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-6719c2bc-c22e-4df4-aaba-c1b2e91408e3 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Getting quotas for user ad76e9906e5341869af05aace8368403 and project b981a3c2d7974c7ca0c54a5262ea5220. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:21:03.073506 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-6719c2bc-c22e-4df4-aaba-c1b2e91408e3 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Getting quotas for project b981a3c2d7974c7ca0c54a5262ea5220. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:21:03.080281 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-6719c2bc-c22e-4df4-aaba-c1b2e91408e3 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Getting quotas for user ad76e9906e5341869af05aace8368403 and project b981a3c2d7974c7ca0c54a5262ea5220. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:21:03.106619 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6719c2bc-c22e-4df4-aaba-c1b2e91408e3 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.536456 Nov 24 15:21:03.108347 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 122/213] 10.222.0.66 () {60 vars in 1157 bytes} [Wed Nov 24 15:21:02 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:03.551847 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-888b73d5-7384-4978-97ef-ade9a096ebc8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:03.552839 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-888b73d5-7384-4978-97ef-ade9a096ebc8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:03.561538 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-888b73d5-7384-4978-97ef-ade9a096ebc8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:03.562224 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-888b73d5-7384-4978-97ef-ade9a096ebc8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:03.563183 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-888b73d5-7384-4978-97ef-ade9a096ebc8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:03.563678 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-888b73d5-7384-4978-97ef-ade9a096ebc8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:03.669157 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-888b73d5-7384-4978-97ef-ade9a096ebc8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 36079 microversion: 2.1 time: 0.120811 Nov 24 15:21:03.670612 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 92/214] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:21:03 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 36079 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:21:04.427793 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-460900c0-a06b-4d8f-a6af-898027856f0d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:04.429509 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-460900c0-a06b-4d8f-a6af-898027856f0d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:04.441655 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-460900c0-a06b-4d8f-a6af-898027856f0d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:04.442512 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-460900c0-a06b-4d8f-a6af-898027856f0d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:04.443869 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-460900c0-a06b-4d8f-a6af-898027856f0d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:04.444535 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-460900c0-a06b-4d8f-a6af-898027856f0d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:04.480864 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-460900c0-a06b-4d8f-a6af-898027856f0d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lazy-loading 'flavor' on Instance uuid 54c23d97-138c-40a2-9593-8896dfdb2650 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:21:04.630306 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-460900c0-a06b-4d8f-a6af-898027856f0d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "POST /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/action" status: 200 len: 32 microversion: 2.1 time: 0.206229 Nov 24 15:21:04.631584 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 123/215] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:21:04 2021] POST /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/action => generated 32 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:21:04.651290 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ca635d17-225d-47f9-99d0-8108608dc95c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:04.655515 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ca635d17-225d-47f9-99d0-8108608dc95c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:04.670873 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca635d17-225d-47f9-99d0-8108608dc95c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:04.671728 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca635d17-225d-47f9-99d0-8108608dc95c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:04.673221 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca635d17-225d-47f9-99d0-8108608dc95c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:04.674000 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca635d17-225d-47f9-99d0-8108608dc95c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:04.686272 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4a4273ff-98c3-4d3d-82a8-17e41f578ef9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:04.687466 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4a4273ff-98c3-4d3d-82a8-17e41f578ef9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:04.701722 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4a4273ff-98c3-4d3d-82a8-17e41f578ef9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:04.702192 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4a4273ff-98c3-4d3d-82a8-17e41f578ef9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:04.703035 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4a4273ff-98c3-4d3d-82a8-17e41f578ef9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:04.705215 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4a4273ff-98c3-4d3d-82a8-17e41f578ef9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:04.954570 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ca635d17-225d-47f9-99d0-8108608dc95c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:04.972936 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ca635d17-225d-47f9-99d0-8108608dc95c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.334098 Nov 24 15:21:04.983504 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 93/216] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:04 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:05.993596 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-63dbd96f-fbfb-4a7c-849f-b97e4c460f47 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:05.994283 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-63dbd96f-fbfb-4a7c-849f-b97e4c460f47 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:06.001602 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-63dbd96f-fbfb-4a7c-849f-b97e4c460f47 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:06.002054 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-63dbd96f-fbfb-4a7c-849f-b97e4c460f47 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:06.002882 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-63dbd96f-fbfb-4a7c-849f-b97e4c460f47 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:06.003322 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-63dbd96f-fbfb-4a7c-849f-b97e4c460f47 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:06.143579 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-63dbd96f-fbfb-4a7c-849f-b97e4c460f47 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:06.151590 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-63dbd96f-fbfb-4a7c-849f-b97e4c460f47 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.161669 Nov 24 15:21:06.152520 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 94/217] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:05 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:06.883052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4a4273ff-98c3-4d3d-82a8-17e41f578ef9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 38123 microversion: 2.1 time: 2.204194 Nov 24 15:21:06.883543 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 124/218] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:21:04 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 38123 bytes in 2206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:21:07.168414 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-299e6efd-2fe7-405e-9242-b0ac61cd4333 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:07.169010 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-299e6efd-2fe7-405e-9242-b0ac61cd4333 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:07.176434 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-299e6efd-2fe7-405e-9242-b0ac61cd4333 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:07.177596 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-299e6efd-2fe7-405e-9242-b0ac61cd4333 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:07.178732 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-299e6efd-2fe7-405e-9242-b0ac61cd4333 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:07.179043 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-299e6efd-2fe7-405e-9242-b0ac61cd4333 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:07.428210 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-299e6efd-2fe7-405e-9242-b0ac61cd4333 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:07.438124 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-299e6efd-2fe7-405e-9242-b0ac61cd4333 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.273124 Nov 24 15:21:07.438790 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 95/219] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:07 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:07.895322 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e04439f3-6d20-4309-8a10-b4e4d3c2b1a6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:07.896223 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e04439f3-6d20-4309-8a10-b4e4d3c2b1a6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:07.903273 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e04439f3-6d20-4309-8a10-b4e4d3c2b1a6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:07.904417 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e04439f3-6d20-4309-8a10-b4e4d3c2b1a6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:07.905498 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e04439f3-6d20-4309-8a10-b4e4d3c2b1a6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:07.906017 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e04439f3-6d20-4309-8a10-b4e4d3c2b1a6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:08.456980 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3c533272-6c7c-4e59-a952-6f184eb0b4b6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:08.457552 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3c533272-6c7c-4e59-a952-6f184eb0b4b6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:08.463815 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3c533272-6c7c-4e59-a952-6f184eb0b4b6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:08.464263 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3c533272-6c7c-4e59-a952-6f184eb0b4b6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:08.465031 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3c533272-6c7c-4e59-a952-6f184eb0b4b6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:08.465473 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3c533272-6c7c-4e59-a952-6f184eb0b4b6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:08.599619 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-3c533272-6c7c-4e59-a952-6f184eb0b4b6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:08.606719 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3c533272-6c7c-4e59-a952-6f184eb0b4b6 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.153482 Nov 24 15:21:08.607312 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 96/220] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:08 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:09.623589 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-360aaa53-998a-4187-ba92-1610f59c7f35 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:09.624196 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-360aaa53-998a-4187-ba92-1610f59c7f35 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:09.630704 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-360aaa53-998a-4187-ba92-1610f59c7f35 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:09.631189 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-360aaa53-998a-4187-ba92-1610f59c7f35 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:09.632033 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-360aaa53-998a-4187-ba92-1610f59c7f35 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:09.632520 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-360aaa53-998a-4187-ba92-1610f59c7f35 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:09.763549 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-360aaa53-998a-4187-ba92-1610f59c7f35 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:09.771288 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-360aaa53-998a-4187-ba92-1610f59c7f35 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.151196 Nov 24 15:21:09.772188 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 97/221] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:09 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:10.547062 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e04439f3-6d20-4309-8a10-b4e4d3c2b1a6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 200 len: 38252 microversion: 2.1 time: 2.655512 Nov 24 15:21:10.547719 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 125/222] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:21:07 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 38252 bytes in 2657 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:21:10.557158 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-5031bfb0-a8ff-4630-baaf-2eb0352e7ee4 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:10.557650 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-5031bfb0-a8ff-4630-baaf-2eb0352e7ee4 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:10.564340 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5031bfb0-a8ff-4630-baaf-2eb0352e7ee4 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:10.564787 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5031bfb0-a8ff-4630-baaf-2eb0352e7ee4 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:10.565650 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5031bfb0-a8ff-4630-baaf-2eb0352e7ee4 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:10.566090 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5031bfb0-a8ff-4630-baaf-2eb0352e7ee4 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:10.589063 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-5031bfb0-a8ff-4630-baaf-2eb0352e7ee4 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/ips" status: 200 len: 145 microversion: 2.1 time: 0.035446 Nov 24 15:21:10.589632 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 98/223] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Nov 24 15:21:10 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:21:10.790356 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-11f16f0d-573f-40ef-86f6-c99b52f405b4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:10.791064 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-11f16f0d-573f-40ef-86f6-c99b52f405b4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:10.799442 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11f16f0d-573f-40ef-86f6-c99b52f405b4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:10.799833 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11f16f0d-573f-40ef-86f6-c99b52f405b4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:10.800636 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11f16f0d-573f-40ef-86f6-c99b52f405b4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:10.801069 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11f16f0d-573f-40ef-86f6-c99b52f405b4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:10.940210 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-11f16f0d-573f-40ef-86f6-c99b52f405b4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:10.948140 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-11f16f0d-573f-40ef-86f6-c99b52f405b4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.161597 Nov 24 15:21:10.948778 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 126/224] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:10 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:11.965054 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f2b65c7c-738a-4002-bd14-022571a82d2d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:11.965561 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-f2b65c7c-738a-4002-bd14-022571a82d2d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:11.972504 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f2b65c7c-738a-4002-bd14-022571a82d2d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:11.972953 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f2b65c7c-738a-4002-bd14-022571a82d2d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:11.973728 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f2b65c7c-738a-4002-bd14-022571a82d2d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:11.974160 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f2b65c7c-738a-4002-bd14-022571a82d2d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:12.106284 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-f2b65c7c-738a-4002-bd14-022571a82d2d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:12.114454 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f2b65c7c-738a-4002-bd14-022571a82d2d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.152807 Nov 24 15:21:12.115059 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 99/225] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:11 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:13.132086 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c1c25816-8e00-4115-8deb-426bbfecda97 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:13.132621 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c1c25816-8e00-4115-8deb-426bbfecda97 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:13.139383 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c1c25816-8e00-4115-8deb-426bbfecda97 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:13.139832 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c1c25816-8e00-4115-8deb-426bbfecda97 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:13.140601 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c1c25816-8e00-4115-8deb-426bbfecda97 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:13.141103 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c1c25816-8e00-4115-8deb-426bbfecda97 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:13.281361 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c1c25816-8e00-4115-8deb-426bbfecda97 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:13.289046 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c1c25816-8e00-4115-8deb-426bbfecda97 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.160654 Nov 24 15:21:13.289624 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 127/226] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:13 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:14.306691 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-1f1a0ffd-6f0f-4cf3-abc6-7e6a6b89f34a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:14.307384 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-1f1a0ffd-6f0f-4cf3-abc6-7e6a6b89f34a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:14.314496 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1f1a0ffd-6f0f-4cf3-abc6-7e6a6b89f34a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:14.315001 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1f1a0ffd-6f0f-4cf3-abc6-7e6a6b89f34a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:14.315897 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1f1a0ffd-6f0f-4cf3-abc6-7e6a6b89f34a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:14.316564 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1f1a0ffd-6f0f-4cf3-abc6-7e6a6b89f34a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:14.447213 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-1f1a0ffd-6f0f-4cf3-abc6-7e6a6b89f34a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:14.456728 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-1f1a0ffd-6f0f-4cf3-abc6-7e6a6b89f34a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.153305 Nov 24 15:21:14.457056 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 100/227] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:14 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:15.473071 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9da6af69-9dd3-44b1-8e76-f84a5e3a5713 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:15.473590 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9da6af69-9dd3-44b1-8e76-f84a5e3a5713 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:15.479794 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9da6af69-9dd3-44b1-8e76-f84a5e3a5713 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:15.480240 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9da6af69-9dd3-44b1-8e76-f84a5e3a5713 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:15.481011 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9da6af69-9dd3-44b1-8e76-f84a5e3a5713 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:15.481440 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9da6af69-9dd3-44b1-8e76-f84a5e3a5713 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:15.618838 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9da6af69-9dd3-44b1-8e76-f84a5e3a5713 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:15.626498 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9da6af69-9dd3-44b1-8e76-f84a5e3a5713 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.157197 Nov 24 15:21:15.627104 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 128/228] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:15 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:16.645555 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2afe17b6-7bb6-4d30-8a34-79d27260a344 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:16.647998 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2afe17b6-7bb6-4d30-8a34-79d27260a344 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:16.659282 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2afe17b6-7bb6-4d30-8a34-79d27260a344 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:16.659960 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2afe17b6-7bb6-4d30-8a34-79d27260a344 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:16.661441 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2afe17b6-7bb6-4d30-8a34-79d27260a344 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:16.662032 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2afe17b6-7bb6-4d30-8a34-79d27260a344 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:16.826095 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-2afe17b6-7bb6-4d30-8a34-79d27260a344 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:16.835053 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2afe17b6-7bb6-4d30-8a34-79d27260a344 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.194526 Nov 24 15:21:16.835643 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 101/229] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:16 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:17.104583 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8c000dab-cd3f-4d4b-9378-6a510d8f3d73 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcc1403d-fdc7-473f-99a7-7813d694f06d"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:17.105622 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8c000dab-cd3f-4d4b-9378-6a510d8f3d73 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:17.112513 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c000dab-cd3f-4d4b-9378-6a510d8f3d73 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:17.112881 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c000dab-cd3f-4d4b-9378-6a510d8f3d73 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:17.113586 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c000dab-cd3f-4d4b-9378-6a510d8f3d73 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:17.114014 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8c000dab-cd3f-4d4b-9378-6a510d8f3d73 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:17.383171 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8c000dab-cd3f-4d4b-9378-6a510d8f3d73 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281907 Nov 24 15:21:17.383869 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 129/230] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Nov 24 15:21:17 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:21:17.854210 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-de878b82-8326-4994-bbbb-ebf4c36e06c2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:17.854838 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-de878b82-8326-4994-bbbb-ebf4c36e06c2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:17.863650 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-de878b82-8326-4994-bbbb-ebf4c36e06c2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:17.864460 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-de878b82-8326-4994-bbbb-ebf4c36e06c2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:17.865296 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-de878b82-8326-4994-bbbb-ebf4c36e06c2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:17.865692 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-de878b82-8326-4994-bbbb-ebf4c36e06c2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:18.092829 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-de878b82-8326-4994-bbbb-ebf4c36e06c2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:18.104515 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-de878b82-8326-4994-bbbb-ebf4c36e06c2 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.254168 Nov 24 15:21:18.105104 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 102/231] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:17 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:19.122955 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d487dc43-ca95-4adf-9aeb-5a2bcf3f9b31 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:19.124358 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d487dc43-ca95-4adf-9aeb-5a2bcf3f9b31 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:19.131063 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d487dc43-ca95-4adf-9aeb-5a2bcf3f9b31 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:19.131514 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d487dc43-ca95-4adf-9aeb-5a2bcf3f9b31 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:19.132292 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d487dc43-ca95-4adf-9aeb-5a2bcf3f9b31 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:19.132724 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d487dc43-ca95-4adf-9aeb-5a2bcf3f9b31 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:19.275847 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d487dc43-ca95-4adf-9aeb-5a2bcf3f9b31 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:19.299264 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d487dc43-ca95-4adf-9aeb-5a2bcf3f9b31 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.170563 Nov 24 15:21:19.299264 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 130/232] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:19 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:20.307540 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-eca2d5e1-607d-486c-aad1-1fc48fe9e012 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:20.308145 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-eca2d5e1-607d-486c-aad1-1fc48fe9e012 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:20.329644 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eca2d5e1-607d-486c-aad1-1fc48fe9e012 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:20.330461 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eca2d5e1-607d-486c-aad1-1fc48fe9e012 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:20.332166 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eca2d5e1-607d-486c-aad1-1fc48fe9e012 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:20.332975 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eca2d5e1-607d-486c-aad1-1fc48fe9e012 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:20.488464 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-eca2d5e1-607d-486c-aad1-1fc48fe9e012 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:20.496571 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-eca2d5e1-607d-486c-aad1-1fc48fe9e012 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.193282 Nov 24 15:21:20.497352 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 103/233] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:20 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:21.514231 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-09e365b7-ed8b-4809-9024-31ea818934eb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:21.515192 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-09e365b7-ed8b-4809-9024-31ea818934eb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:21.521318 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-09e365b7-ed8b-4809-9024-31ea818934eb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:21.521770 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-09e365b7-ed8b-4809-9024-31ea818934eb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:21.522554 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-09e365b7-ed8b-4809-9024-31ea818934eb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:21.523038 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-09e365b7-ed8b-4809-9024-31ea818934eb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:21.654105 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-09e365b7-ed8b-4809-9024-31ea818934eb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:21.662109 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-09e365b7-ed8b-4809-9024-31ea818934eb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.151602 Nov 24 15:21:21.662693 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 131/234] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:21 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:22.679649 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8495c801-9d84-4cc6-8f63-2ef795506f28 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:22.680251 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8495c801-9d84-4cc6-8f63-2ef795506f28 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:22.687345 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8495c801-9d84-4cc6-8f63-2ef795506f28 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:22.687789 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8495c801-9d84-4cc6-8f63-2ef795506f28 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:22.689147 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8495c801-9d84-4cc6-8f63-2ef795506f28 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:22.689274 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8495c801-9d84-4cc6-8f63-2ef795506f28 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:22.833686 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8495c801-9d84-4cc6-8f63-2ef795506f28 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:22.844133 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8495c801-9d84-4cc6-8f63-2ef795506f28 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.168265 Nov 24 15:21:22.844745 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 104/235] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:22 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:23.865280 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b5c95a3e-164f-4fe8-994e-774d64ea1798 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:23.866846 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b5c95a3e-164f-4fe8-994e-774d64ea1798 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:23.879589 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5c95a3e-164f-4fe8-994e-774d64ea1798 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:23.880233 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5c95a3e-164f-4fe8-994e-774d64ea1798 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:23.882028 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5c95a3e-164f-4fe8-994e-774d64ea1798 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:23.883476 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5c95a3e-164f-4fe8-994e-774d64ea1798 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:24.061966 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b5c95a3e-164f-4fe8-994e-774d64ea1798 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:24.070785 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b5c95a3e-164f-4fe8-994e-774d64ea1798 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.210053 Nov 24 15:21:24.071632 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 132/236] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:23 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:25.104952 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-d4638eac-761c-43d2-a57b-5b0a55ac4c3b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:25.107181 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-d4638eac-761c-43d2-a57b-5b0a55ac4c3b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:25.122794 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d4638eac-761c-43d2-a57b-5b0a55ac4c3b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:25.126119 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d4638eac-761c-43d2-a57b-5b0a55ac4c3b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:25.135373 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d4638eac-761c-43d2-a57b-5b0a55ac4c3b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:25.136192 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d4638eac-761c-43d2-a57b-5b0a55ac4c3b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:25.173290 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-437526798", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452", "networks": [{"uuid": "c60d9449-ba6f-4d12-83b1-6f849f230180"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:25.288258 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] validate_networks() for [('c60d9449-ba6f-4d12-83b1-6f849f230180', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:21:25.563419 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-d4638eac-761c-43d2-a57b-5b0a55ac4c3b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:25.571947 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-d4638eac-761c-43d2-a57b-5b0a55ac4c3b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.477339 Nov 24 15:21:25.584852 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 105/237] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:25 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:25.592598 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-730dfc86-ceb9-485d-8d99-a05475945d6d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:25.620462 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-730dfc86-ceb9-485d-8d99-a05475945d6d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:25.621894 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-730dfc86-ceb9-485d-8d99-a05475945d6d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:25.773272 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-730dfc86-ceb9-485d-8d99-a05475945d6d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Going to try to stop instance {{(pid=116073) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 24 15:21:25.853564 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-730dfc86-ceb9-485d-8d99-a05475945d6d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 202 len: 0 microversion: 2.1 time: 0.266838 Nov 24 15:21:25.855054 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 106/238] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:21:25 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:21:25.881112 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b1a2144a-ce8e-41be-a808-be4253d29788 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:25.883766 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b1a2144a-ce8e-41be-a808-be4253d29788 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:25.903683 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b1a2144a-ce8e-41be-a808-be4253d29788 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:25.905175 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b1a2144a-ce8e-41be-a808-be4253d29788 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:25.907469 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b1a2144a-ce8e-41be-a808-be4253d29788 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:25.908260 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b1a2144a-ce8e-41be-a808-be4253d29788 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:26.002524 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:21:26.003480 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:21:26.004241 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:21:26.004936 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:21:26.005558 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:21:26.022657 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:26.030203 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:26.031714 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:26.032308 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:26.071112 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Getting quotas for project 47d3bc717a2e4d3f8a7eb27026602262. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:21:26.084671 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Getting quotas for user 96f595b5dbbd439f9f493e47141b4dfb and project 47d3bc717a2e4d3f8a7eb27026602262. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:21:26.099431 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:21:26.102537 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:21:26.109742 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-b1a2144a-ce8e-41be-a808-be4253d29788 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:26.121335 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b1a2144a-ce8e-41be-a808-be4253d29788 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.252923 Nov 24 15:21:26.124257 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 107/239] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:25 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:26.159371 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4f4eb672-5a84-47eb-9aa9-f8a353d19058 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989606 Nov 24 15:21:26.164733 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 133/240] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:21:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:21:26.172345 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-647f7482-707e-46ce-a8b2-46470c74ddfe tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:26.178078 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-647f7482-707e-46ce-a8b2-46470c74ddfe tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:26.243664 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-647f7482-707e-46ce-a8b2-46470c74ddfe tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:26.252149 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-647f7482-707e-46ce-a8b2-46470c74ddfe tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1213 microversion: 2.1 time: 0.084496 Nov 24 15:21:26.269063 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 108/241] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:26 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:26.594628 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-005e3e7b-459b-49e9-a1dd-27d860faf76e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:26.595997 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-005e3e7b-459b-49e9-a1dd-27d860faf76e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:26.607154 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-005e3e7b-459b-49e9-a1dd-27d860faf76e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:26.608070 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-005e3e7b-459b-49e9-a1dd-27d860faf76e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:26.608883 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-005e3e7b-459b-49e9-a1dd-27d860faf76e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:26.609324 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-005e3e7b-459b-49e9-a1dd-27d860faf76e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:26.787795 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-005e3e7b-459b-49e9-a1dd-27d860faf76e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:26.797527 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-005e3e7b-459b-49e9-a1dd-27d860faf76e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.206542 Nov 24 15:21:26.798782 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 134/242] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:26 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:27.140743 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6a7b7e20-1c77-469b-aba3-2790874a11e7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:27.142309 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6a7b7e20-1c77-469b-aba3-2790874a11e7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:27.148631 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6a7b7e20-1c77-469b-aba3-2790874a11e7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:27.149257 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6a7b7e20-1c77-469b-aba3-2790874a11e7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:27.150347 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6a7b7e20-1c77-469b-aba3-2790874a11e7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:27.150955 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6a7b7e20-1c77-469b-aba3-2790874a11e7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:27.271077 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-659c76e4-a057-4ed9-9b3a-d7afdc82aa81 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:27.271885 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-659c76e4-a057-4ed9-9b3a-d7afdc82aa81 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:27.286145 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-659c76e4-a057-4ed9-9b3a-d7afdc82aa81 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:27.286884 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-659c76e4-a057-4ed9-9b3a-d7afdc82aa81 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:27.288361 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-659c76e4-a057-4ed9-9b3a-d7afdc82aa81 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:27.288950 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-659c76e4-a057-4ed9-9b3a-d7afdc82aa81 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:27.341157 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6a7b7e20-1c77-469b-aba3-2790874a11e7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:27.352406 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6a7b7e20-1c77-469b-aba3-2790874a11e7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.215718 Nov 24 15:21:27.353336 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 109/243] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:27 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:27.371120 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-659c76e4-a057-4ed9-9b3a-d7afdc82aa81 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:27.382354 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-659c76e4-a057-4ed9-9b3a-d7afdc82aa81 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1217 microversion: 2.1 time: 0.116698 Nov 24 15:21:27.384419 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 135/244] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:27 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:27.816909 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-18a007ad-ab4e-41f6-aee3-934f037f7906 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:27.818200 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-18a007ad-ab4e-41f6-aee3-934f037f7906 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:27.824663 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-18a007ad-ab4e-41f6-aee3-934f037f7906 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:27.825172 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-18a007ad-ab4e-41f6-aee3-934f037f7906 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:27.826161 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-18a007ad-ab4e-41f6-aee3-934f037f7906 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:27.826740 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-18a007ad-ab4e-41f6-aee3-934f037f7906 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:27.977424 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-18a007ad-ab4e-41f6-aee3-934f037f7906 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:27.988914 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-18a007ad-ab4e-41f6-aee3-934f037f7906 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.175723 Nov 24 15:21:27.990181 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 110/245] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:27 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:28.373430 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b1bc786c-06be-4ce9-b9cd-5f490d91bd11 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:28.389576 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b1bc786c-06be-4ce9-b9cd-5f490d91bd11 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:28.403848 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1bc786c-06be-4ce9-b9cd-5f490d91bd11 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:28.404310 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1bc786c-06be-4ce9-b9cd-5f490d91bd11 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:28.405097 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1bc786c-06be-4ce9-b9cd-5f490d91bd11 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:28.405448 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-dc59d84e-cded-4003-a7c1-56ead19a8333 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:28.405970 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1bc786c-06be-4ce9-b9cd-5f490d91bd11 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:28.409387 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-dc59d84e-cded-4003-a7c1-56ead19a8333 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:28.424911 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dc59d84e-cded-4003-a7c1-56ead19a8333 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:28.425759 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dc59d84e-cded-4003-a7c1-56ead19a8333 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:28.428989 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dc59d84e-cded-4003-a7c1-56ead19a8333 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:28.429855 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dc59d84e-cded-4003-a7c1-56ead19a8333 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:28.525616 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-dc59d84e-cded-4003-a7c1-56ead19a8333 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:28.536328 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-dc59d84e-cded-4003-a7c1-56ead19a8333 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1265 microversion: 2.1 time: 0.138617 Nov 24 15:21:28.538745 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 111/246] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:28 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1265 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:28.691140 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b1bc786c-06be-4ce9-b9cd-5f490d91bd11 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:28.702306 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b1bc786c-06be-4ce9-b9cd-5f490d91bd11 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.332248 Nov 24 15:21:28.703352 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 136/247] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:28 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:29.007486 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6925c6e8-84dd-46d8-8885-39abe17b576b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:29.016501 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6925c6e8-84dd-46d8-8885-39abe17b576b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:29.032562 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6925c6e8-84dd-46d8-8885-39abe17b576b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:29.033043 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6925c6e8-84dd-46d8-8885-39abe17b576b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:29.041643 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6925c6e8-84dd-46d8-8885-39abe17b576b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:29.042431 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6925c6e8-84dd-46d8-8885-39abe17b576b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:29.556448 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1518867d-8db6-43b7-8ca7-f5d402c107e0 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:29.557231 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1518867d-8db6-43b7-8ca7-f5d402c107e0 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:29.589911 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1518867d-8db6-43b7-8ca7-f5d402c107e0 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:29.590376 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1518867d-8db6-43b7-8ca7-f5d402c107e0 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:29.591326 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1518867d-8db6-43b7-8ca7-f5d402c107e0 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:29.595316 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1518867d-8db6-43b7-8ca7-f5d402c107e0 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:29.724767 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6925c6e8-84dd-46d8-8885-39abe17b576b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:29.725670 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1518867d-8db6-43b7-8ca7-f5d402c107e0 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:29.745200 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1518867d-8db6-43b7-8ca7-f5d402c107e0 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1271 microversion: 2.1 time: 0.190081 Nov 24 15:21:29.757591 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6925c6e8-84dd-46d8-8885-39abe17b576b tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.742097 Nov 24 15:21:29.758127 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 137/248] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:29 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1271 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:29.760926 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 112/249] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:29 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:29.765928 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-39a880ba-825a-480e-9a47-8a3052798786 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:29.766586 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-39a880ba-825a-480e-9a47-8a3052798786 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:29.773792 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-39a880ba-825a-480e-9a47-8a3052798786 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:29.774585 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-39a880ba-825a-480e-9a47-8a3052798786 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:29.777698 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-39a880ba-825a-480e-9a47-8a3052798786 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:29.778367 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-39a880ba-825a-480e-9a47-8a3052798786 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:30.062091 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-39a880ba-825a-480e-9a47-8a3052798786 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:30.088759 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-39a880ba-825a-480e-9a47-8a3052798786 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.324081 Nov 24 15:21:30.090230 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 138/250] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:29 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:30.765339 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-9b3b5f3f-87d5-48ac-991f-137b1948b48c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:30.766974 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-9b3b5f3f-87d5-48ac-991f-137b1948b48c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:30.778259 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3bd1d299-1611-4a2c-8c4e-3e3032960699 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:30.779700 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3bd1d299-1611-4a2c-8c4e-3e3032960699 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:30.793644 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9b3b5f3f-87d5-48ac-991f-137b1948b48c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:30.794389 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9b3b5f3f-87d5-48ac-991f-137b1948b48c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:30.797798 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3bd1d299-1611-4a2c-8c4e-3e3032960699 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:30.798254 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3bd1d299-1611-4a2c-8c4e-3e3032960699 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:30.799085 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3bd1d299-1611-4a2c-8c4e-3e3032960699 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:30.799518 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3bd1d299-1611-4a2c-8c4e-3e3032960699 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:30.802218 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9b3b5f3f-87d5-48ac-991f-137b1948b48c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:30.802218 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9b3b5f3f-87d5-48ac-991f-137b1948b48c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:31.303755 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3bd1d299-1611-4a2c-8c4e-3e3032960699 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:31.312506 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3bd1d299-1611-4a2c-8c4e-3e3032960699 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.537842 Nov 24 15:21:31.317562 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 139/251] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:30 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:31.336606 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c755ba3a-b533-4d57-8acc-c9e227a8f31b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:31.337227 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c755ba3a-b533-4d57-8acc-c9e227a8f31b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:31.344571 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c755ba3a-b533-4d57-8acc-c9e227a8f31b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:31.353739 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c755ba3a-b533-4d57-8acc-c9e227a8f31b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:31.357448 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c755ba3a-b533-4d57-8acc-c9e227a8f31b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:31.357935 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c755ba3a-b533-4d57-8acc-c9e227a8f31b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:31.516134 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-9b3b5f3f-87d5-48ac-991f-137b1948b48c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:31.527066 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-9b3b5f3f-87d5-48ac-991f-137b1948b48c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1313 microversion: 2.1 time: 0.766289 Nov 24 15:21:31.533236 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 113/252] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:30 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1313 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:31.765896 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c755ba3a-b533-4d57-8acc-c9e227a8f31b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:31.775735 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c755ba3a-b533-4d57-8acc-c9e227a8f31b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.455604 Nov 24 15:21:31.780367 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 140/253] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:31 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:32.047967 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-c9ca9d8d-4c6b-4317-9c84-a782501cdea6 req-2f63d567-c4ee-4ed1-8ba8-48357559d3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb768cae-085e-4df1-9bf9-9ff9dc62da9c", "tag": "346a622a-2a2d-47d6-a817-b82b31b249a0"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:32.049805 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:21:32.049805 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:21:32.084156 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-c9ca9d8d-4c6b-4317-9c84-a782501cdea6 req-2f63d567-c4ee-4ed1-8ba8-48357559d3e8 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:32.084608 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-c9ca9d8d-4c6b-4317-9c84-a782501cdea6 req-2f63d567-c4ee-4ed1-8ba8-48357559d3e8 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:32.120638 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-c9ca9d8d-4c6b-4317-9c84-a782501cdea6 req-2f63d567-c4ee-4ed1-8ba8-48357559d3e8 service nova] Creating event network-changed:346a622a-2a2d-47d6-a817-b82b31b249a0 for instance eb768cae-085e-4df1-9bf9-9ff9dc62da9c on hv-cinder-80403 Nov 24 15:21:32.136383 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-c9ca9d8d-4c6b-4317-9c84-a782501cdea6 req-2f63d567-c4ee-4ed1-8ba8-48357559d3e8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093174 Nov 24 15:21:32.138736 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 114/254] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:21:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:21:32.342457 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-92fab01e-6aaa-4fd6-8374-2a860794b0cc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:32.343961 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-92fab01e-6aaa-4fd6-8374-2a860794b0cc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:32.365064 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-92fab01e-6aaa-4fd6-8374-2a860794b0cc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:32.370087 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-92fab01e-6aaa-4fd6-8374-2a860794b0cc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:32.373786 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-92fab01e-6aaa-4fd6-8374-2a860794b0cc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:32.378723 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-92fab01e-6aaa-4fd6-8374-2a860794b0cc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:32.550591 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-caf35c8b-e39e-43b8-8129-481e207b1d58 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:32.551523 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-caf35c8b-e39e-43b8-8129-481e207b1d58 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:32.564494 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-caf35c8b-e39e-43b8-8129-481e207b1d58 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:32.567069 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-caf35c8b-e39e-43b8-8129-481e207b1d58 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:32.571201 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-caf35c8b-e39e-43b8-8129-481e207b1d58 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:32.571891 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-caf35c8b-e39e-43b8-8129-481e207b1d58 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:33.130694 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-92fab01e-6aaa-4fd6-8374-2a860794b0cc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:33.145954 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-92fab01e-6aaa-4fd6-8374-2a860794b0cc tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1502 microversion: 2.1 time: 0.817154 Nov 24 15:21:33.149146 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 141/255] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:32 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1502 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:33.160420 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-dcca2110-8c86-4e82-9762-3b99b3bab127 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:33.163034 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-dcca2110-8c86-4e82-9762-3b99b3bab127 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:33.179740 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dcca2110-8c86-4e82-9762-3b99b3bab127 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:33.180830 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dcca2110-8c86-4e82-9762-3b99b3bab127 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:33.184695 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dcca2110-8c86-4e82-9762-3b99b3bab127 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:33.187192 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dcca2110-8c86-4e82-9762-3b99b3bab127 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:33.377015 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-caf35c8b-e39e-43b8-8129-481e207b1d58 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:33.388421 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-caf35c8b-e39e-43b8-8129-481e207b1d58 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1313 microversion: 2.1 time: 0.839693 Nov 24 15:21:33.399599 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 115/256] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:32 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1313 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:33.403504 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-fa806931-346b-455b-bd27-8988584f3b65 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1be0c701-ab2d-4080-a995-63f7781d92ed"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:33.406828 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-fa806931-346b-455b-bd27-8988584f3b65 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:33.427253 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fa806931-346b-455b-bd27-8988584f3b65 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:33.427832 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fa806931-346b-455b-bd27-8988584f3b65 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:33.429188 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fa806931-346b-455b-bd27-8988584f3b65 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:33.429626 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fa806931-346b-455b-bd27-8988584f3b65 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:33.512733 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-fa806931-346b-455b-bd27-8988584f3b65 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] HTTP exception thrown: Cannot 'attach_volume' instance 54c23d97-138c-40a2-9593-8896dfdb2650 while it is in vm_state rescued Nov 24 15:21:33.513382 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-fa806931-346b-455b-bd27-8988584f3b65 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Returning 409 to user: Cannot 'attach_volume' instance 54c23d97-138c-40a2-9593-8896dfdb2650 while it is in vm_state rescued {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:21:33.514747 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-fa806931-346b-455b-bd27-8988584f3b65 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "POST /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.122605 Nov 24 15:21:33.523106 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 116/257] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Nov 24 15:21:33 2021] POST /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/os-volume_attachments => generated 152 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 24 15:21:33.549818 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ff5f8490-f196-481e-b7de-fa40d7efc06d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:33.551939 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ff5f8490-f196-481e-b7de-fa40d7efc06d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:33.569063 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff5f8490-f196-481e-b7de-fa40d7efc06d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:33.570739 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff5f8490-f196-481e-b7de-fa40d7efc06d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:33.571842 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff5f8490-f196-481e-b7de-fa40d7efc06d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:33.573211 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff5f8490-f196-481e-b7de-fa40d7efc06d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:33.758849 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ff5f8490-f196-481e-b7de-fa40d7efc06d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "POST /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/action" status: 202 len: 0 microversion: 2.1 time: 0.225707 Nov 24 15:21:33.786454 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 117/258] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:21:33 2021] POST /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:21:33.803208 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ebc2443e-46c0-455f-89a3-2bea91a18c72 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:33.804453 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ebc2443e-46c0-455f-89a3-2bea91a18c72 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:33.838453 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebc2443e-46c0-455f-89a3-2bea91a18c72 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:33.839682 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebc2443e-46c0-455f-89a3-2bea91a18c72 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:33.841650 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebc2443e-46c0-455f-89a3-2bea91a18c72 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:33.843620 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebc2443e-46c0-455f-89a3-2bea91a18c72 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:34.262102 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-dcca2110-8c86-4e82-9762-3b99b3bab127 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:34.270551 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-dcca2110-8c86-4e82-9762-3b99b3bab127 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 1.120146 Nov 24 15:21:34.271177 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 142/259] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:33 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:34.410105 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-20f2fe0e-f18f-4fc3-9936-0ab39d71caaf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:34.414150 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-20f2fe0e-f18f-4fc3-9936-0ab39d71caaf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:34.421618 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-20f2fe0e-f18f-4fc3-9936-0ab39d71caaf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:34.422677 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-20f2fe0e-f18f-4fc3-9936-0ab39d71caaf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:34.430599 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-20f2fe0e-f18f-4fc3-9936-0ab39d71caaf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:34.431203 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-20f2fe0e-f18f-4fc3-9936-0ab39d71caaf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:34.959250 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ebc2443e-46c0-455f-89a3-2bea91a18c72 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:34.974910 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ebc2443e-46c0-455f-89a3-2bea91a18c72 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1510 microversion: 2.1 time: 1.175571 Nov 24 15:21:34.975625 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 118/260] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:33 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1510 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:35.241019 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-20f2fe0e-f18f-4fc3-9936-0ab39d71caaf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:35.257369 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-20f2fe0e-f18f-4fc3-9936-0ab39d71caaf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1313 microversion: 2.1 time: 0.853853 Nov 24 15:21:35.258354 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 143/261] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:34 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1313 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:35.287820 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-5f9d78d3-97bb-4dc5-ae25-c373b2f36085 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:35.288766 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-5f9d78d3-97bb-4dc5-ae25-c373b2f36085 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:35.298581 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5f9d78d3-97bb-4dc5-ae25-c373b2f36085 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:35.299060 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5f9d78d3-97bb-4dc5-ae25-c373b2f36085 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:35.299866 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5f9d78d3-97bb-4dc5-ae25-c373b2f36085 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:35.300304 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5f9d78d3-97bb-4dc5-ae25-c373b2f36085 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:35.848257 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-5f9d78d3-97bb-4dc5-ae25-c373b2f36085 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:35.860985 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-5f9d78d3-97bb-4dc5-ae25-c373b2f36085 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.572651 Nov 24 15:21:35.871661 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 119/262] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:35 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:35.994720 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ecf2dde4-3333-4ce4-83c0-296173448a7d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:35.995391 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ecf2dde4-3333-4ce4-83c0-296173448a7d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:36.008629 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ecf2dde4-3333-4ce4-83c0-296173448a7d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:36.011411 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ecf2dde4-3333-4ce4-83c0-296173448a7d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:36.012394 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ecf2dde4-3333-4ce4-83c0-296173448a7d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:36.012759 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ecf2dde4-3333-4ce4-83c0-296173448a7d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:36.275653 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-320a9d17-128e-44a5-a7db-694e085fe7e3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:36.276701 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-320a9d17-128e-44a5-a7db-694e085fe7e3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:36.302761 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-320a9d17-128e-44a5-a7db-694e085fe7e3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:36.303913 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ecf2dde4-3333-4ce4-83c0-296173448a7d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:36.309460 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-320a9d17-128e-44a5-a7db-694e085fe7e3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:36.310757 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-320a9d17-128e-44a5-a7db-694e085fe7e3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:36.314109 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-320a9d17-128e-44a5-a7db-694e085fe7e3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:36.319023 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ecf2dde4-3333-4ce4-83c0-296173448a7d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1510 microversion: 2.1 time: 0.330116 Nov 24 15:21:36.322628 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 144/263] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:35 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1510 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:36.642011 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-320a9d17-128e-44a5-a7db-694e085fe7e3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:36.652505 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-320a9d17-128e-44a5-a7db-694e085fe7e3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1313 microversion: 2.1 time: 0.379502 Nov 24 15:21:36.654740 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 120/264] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:36 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:36.878338 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-81d71e31-449d-4e14-a07f-2160ad9f2bdb tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:36.879330 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-81d71e31-449d-4e14-a07f-2160ad9f2bdb tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:36.894684 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-81d71e31-449d-4e14-a07f-2160ad9f2bdb tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:36.896169 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-81d71e31-449d-4e14-a07f-2160ad9f2bdb tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:36.900910 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-81d71e31-449d-4e14-a07f-2160ad9f2bdb tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:36.901556 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-81d71e31-449d-4e14-a07f-2160ad9f2bdb tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:37.244708 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-81d71e31-449d-4e14-a07f-2160ad9f2bdb tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:37.258094 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-81d71e31-449d-4e14-a07f-2160ad9f2bdb tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.383281 Nov 24 15:21:37.275348 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 145/265] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:36 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:37.335475 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8c3a2df4-1857-4ae5-a3df-2bfbc8427d18 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:37.336175 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8c3a2df4-1857-4ae5-a3df-2bfbc8427d18 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:37.350093 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8c3a2df4-1857-4ae5-a3df-2bfbc8427d18 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:37.353843 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8c3a2df4-1857-4ae5-a3df-2bfbc8427d18 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:37.356514 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8c3a2df4-1857-4ae5-a3df-2bfbc8427d18 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:37.358264 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8c3a2df4-1857-4ae5-a3df-2bfbc8427d18 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:37.514356 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-7fa66474-2bca-4f70-a0c0-96c5cdfb88b9 req-eb62c157-5a98-4096-8d99-eaf9421876ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb768cae-085e-4df1-9bf9-9ff9dc62da9c", "name": "network-vif-plugged", "status": "completed", "tag": "346a622a-2a2d-47d6-a817-b82b31b249a0"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:37.516146 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:21:37.516146 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:21:37.558001 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7fa66474-2bca-4f70-a0c0-96c5cdfb88b9 req-eb62c157-5a98-4096-8d99-eaf9421876ac service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:37.558583 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7fa66474-2bca-4f70-a0c0-96c5cdfb88b9 req-eb62c157-5a98-4096-8d99-eaf9421876ac service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:37.578657 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-7fa66474-2bca-4f70-a0c0-96c5cdfb88b9 req-eb62c157-5a98-4096-8d99-eaf9421876ac service nova] Creating event network-vif-plugged:346a622a-2a2d-47d6-a817-b82b31b249a0 for instance eb768cae-085e-4df1-9bf9-9ff9dc62da9c on hv-cinder-80403 Nov 24 15:21:37.610722 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-7fa66474-2bca-4f70-a0c0-96c5cdfb88b9 req-eb62c157-5a98-4096-8d99-eaf9421876ac service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100416 Nov 24 15:21:37.611457 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 146/266] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:21:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:21:37.657506 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8c3a2df4-1857-4ae5-a3df-2bfbc8427d18 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:37.665063 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8c3a2df4-1857-4ae5-a3df-2bfbc8427d18 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1510 microversion: 2.1 time: 0.333677 Nov 24 15:21:37.666967 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 121/267] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:37 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1510 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:37.679749 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-605b3e3c-b0fd-41cb-bc3a-09c5a7b86455 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:37.680592 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-605b3e3c-b0fd-41cb-bc3a-09c5a7b86455 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:37.689840 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-605b3e3c-b0fd-41cb-bc3a-09c5a7b86455 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:37.691953 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-605b3e3c-b0fd-41cb-bc3a-09c5a7b86455 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:37.694265 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-605b3e3c-b0fd-41cb-bc3a-09c5a7b86455 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:37.698434 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-605b3e3c-b0fd-41cb-bc3a-09c5a7b86455 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:37.883830 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a7b1afd2-0e79-45a0-9346-0a1659d315e3 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Action: 'create', calling method: .version_select at 0x7f930cde10d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-145177780"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:37.898482 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-a7b1afd2-0e79-45a0-9346-0a1659d315e3 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Getting quotas for project a89a75844197496785d27fd3e412344c. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:21:37.903653 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-a7b1afd2-0e79-45a0-9346-0a1659d315e3 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Getting quotas for user 2fbd637c599f4ba6ba3fa26a892c02a1 and project a89a75844197496785d27fd3e412344c. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:21:37.925661 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-605b3e3c-b0fd-41cb-bc3a-09c5a7b86455 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:37.936781 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-605b3e3c-b0fd-41cb-bc3a-09c5a7b86455 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1313 microversion: 2.1 time: 0.266015 Nov 24 15:21:37.938200 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 122/268] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:37 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:37.942745 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1727021658", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1044302524", "security_groups": [{"name": "tempest-secgroup-smoke-1039673694"}], "block_device_mapping_v2": [{"uuid": "bc225131-4c43-430a-9e47-dc69b22ce2c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f26750e4-e797-4f7f-b557-e7463bad5d42"}]}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:38.094413 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.network.neutron [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] validate_networks() for [('f26750e4-e797-4f7f-b557-e7463bad5d42', None, None, None, None, None)] {{(pid=116073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:21:38.254374 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-a7b1afd2-0e79-45a0-9346-0a1659d315e3 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Getting quotas for project a89a75844197496785d27fd3e412344c. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:21:38.261994 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-a7b1afd2-0e79-45a0-9346-0a1659d315e3 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Getting quotas for user 2fbd637c599f4ba6ba3fa26a892c02a1 and project a89a75844197496785d27fd3e412344c. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:21:38.281201 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a7b1afd2-0e79-45a0-9346-0a1659d315e3 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 0.667351 Nov 24 15:21:38.282203 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 147/269] 10.222.0.66 () {60 vars in 1157 bytes} [Wed Nov 24 15:21:37 2021] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:38.296285 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-32bd9cb4-5922-466f-bd4e-941888df09ec tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:38.299626 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-32bd9cb4-5922-466f-bd4e-941888df09ec tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:38.307606 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-32bd9cb4-5922-466f-bd4e-941888df09ec tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:38.308738 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-32bd9cb4-5922-466f-bd4e-941888df09ec tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:38.309693 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-32bd9cb4-5922-466f-bd4e-941888df09ec tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:38.310330 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-32bd9cb4-5922-466f-bd4e-941888df09ec tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:38.688093 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-32bd9cb4-5922-466f-bd4e-941888df09ec tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:38.698246 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-32bd9cb4-5922-466f-bd4e-941888df09ec tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.411354 Nov 24 15:21:38.708950 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 148/270] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:38 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:38.714049 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fb1f3dca-c089-4f9b-9ce2-5f2c6537a78f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:38.714939 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fb1f3dca-c089-4f9b-9ce2-5f2c6537a78f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:38.723267 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fb1f3dca-c089-4f9b-9ce2-5f2c6537a78f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:38.724044 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fb1f3dca-c089-4f9b-9ce2-5f2c6537a78f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:38.726346 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fb1f3dca-c089-4f9b-9ce2-5f2c6537a78f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:38.727552 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fb1f3dca-c089-4f9b-9ce2-5f2c6537a78f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:39.063898 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fb1f3dca-c089-4f9b-9ce2-5f2c6537a78f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:39.072881 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fb1f3dca-c089-4f9b-9ce2-5f2c6537a78f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1510 microversion: 2.1 time: 0.362446 Nov 24 15:21:39.073705 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 149/271] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:38 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1510 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:39.084869 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-73690c5b-870b-4a60-aa82-239e8973483e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:39.085902 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-73690c5b-870b-4a60-aa82-239e8973483e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:39.095259 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-73690c5b-870b-4a60-aa82-239e8973483e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:39.096425 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-73690c5b-870b-4a60-aa82-239e8973483e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:39.116941 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-73690c5b-870b-4a60-aa82-239e8973483e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:39.118235 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-73690c5b-870b-4a60-aa82-239e8973483e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:39.255852 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Flavor limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:21:39.257226 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Image limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:21:39.258020 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Flavor pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:21:39.265616 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Image pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:21:39.266513 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:21:39.290171 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:39.293658 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:39.295396 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:39.296251 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:39.324247 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Getting quotas for project b981a3c2d7974c7ca0c54a5262ea5220. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:21:39.329026 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Getting quotas for user ad76e9906e5341869af05aace8368403 and project b981a3c2d7974c7ca0c54a5262ea5220. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:21:39.385277 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-73690c5b-870b-4a60-aa82-239e8973483e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:39.406170 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-73690c5b-870b-4a60-aa82-239e8973483e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1313 microversion: 2.1 time: 0.329729 Nov 24 15:21:39.411734 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 150/272] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:39 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1313 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:39.464157 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Going to run 1 instances... {{(pid=116073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:21:39.470996 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc225131-4c43-430a-9e47-dc69b22ce2c4',volume_size=None,volume_type=None)] {{(pid=116073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:21:39.715973 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cdfed006-8cf8-4a27-bc4a-68128350d91e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:39.717681 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cdfed006-8cf8-4a27-bc4a-68128350d91e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:39.720101 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-fc315a2b-3e7c-4d44-9029-ea2451c03b36 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.780431 Nov 24 15:21:39.721052 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 123/273] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:21:37 2021] POST /compute/v2.1/servers => generated 406 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:21:39.728499 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cdfed006-8cf8-4a27-bc4a-68128350d91e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:39.729133 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cdfed006-8cf8-4a27-bc4a-68128350d91e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:39.730087 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cdfed006-8cf8-4a27-bc4a-68128350d91e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:39.731028 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cdfed006-8cf8-4a27-bc4a-68128350d91e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:39.737943 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-522abc88-86d6-4dca-bf5f-c92543ed89dc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:39.738626 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-522abc88-86d6-4dca-bf5f-c92543ed89dc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:39.870292 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-522abc88-86d6-4dca-bf5f-c92543ed89dc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:39.877552 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-522abc88-86d6-4dca-bf5f-c92543ed89dc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1095 microversion: 2.1 time: 0.149959 Nov 24 15:21:39.878688 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 124/274] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:39 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1095 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:40.077719 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cdfed006-8cf8-4a27-bc4a-68128350d91e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:40.090577 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cdfed006-8cf8-4a27-bc4a-68128350d91e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.377359 Nov 24 15:21:40.091225 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-11f50178-64cb-4d81-ac5d-d642cf5bdbd9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:40.091974 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-11f50178-64cb-4d81-ac5d-d642cf5bdbd9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:40.102438 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-11f50178-64cb-4d81-ac5d-d642cf5bdbd9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:40.102438 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-11f50178-64cb-4d81-ac5d-d642cf5bdbd9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:40.102609 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-11f50178-64cb-4d81-ac5d-d642cf5bdbd9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:40.103031 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-11f50178-64cb-4d81-ac5d-d642cf5bdbd9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:40.105755 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 151/275] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:39 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:40.398706 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-11f50178-64cb-4d81-ac5d-d642cf5bdbd9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:40.407079 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-11f50178-64cb-4d81-ac5d-d642cf5bdbd9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1510 microversion: 2.1 time: 0.320839 Nov 24 15:21:40.412279 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 125/276] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:40 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1510 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:40.429456 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e15abb4a-a5b3-4caa-80b8-eae0651255be tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:40.430036 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e15abb4a-a5b3-4caa-80b8-eae0651255be tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:40.437560 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e15abb4a-a5b3-4caa-80b8-eae0651255be tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:40.437804 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e15abb4a-a5b3-4caa-80b8-eae0651255be tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:40.438596 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e15abb4a-a5b3-4caa-80b8-eae0651255be tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:40.439062 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e15abb4a-a5b3-4caa-80b8-eae0651255be tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:40.586265 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e15abb4a-a5b3-4caa-80b8-eae0651255be tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:40.598989 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e15abb4a-a5b3-4caa-80b8-eae0651255be tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1313 microversion: 2.1 time: 0.174533 Nov 24 15:21:40.607819 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 152/277] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:40 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:40.894594 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-7e70a44a-72aa-40fe-a7b0-8ddeb820dce8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:40.895649 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-7e70a44a-72aa-40fe-a7b0-8ddeb820dce8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:40.902769 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7e70a44a-72aa-40fe-a7b0-8ddeb820dce8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:40.903242 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7e70a44a-72aa-40fe-a7b0-8ddeb820dce8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:40.904139 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7e70a44a-72aa-40fe-a7b0-8ddeb820dce8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:40.904829 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7e70a44a-72aa-40fe-a7b0-8ddeb820dce8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:40.996937 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-7e70a44a-72aa-40fe-a7b0-8ddeb820dce8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:41.006535 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-7e70a44a-72aa-40fe-a7b0-8ddeb820dce8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1137 microversion: 2.1 time: 0.115885 Nov 24 15:21:41.007922 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 126/278] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:40 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1137 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:41.112419 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cc6045f8-921b-4547-b06a-d248c80f9aa7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:41.113054 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cc6045f8-921b-4547-b06a-d248c80f9aa7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:41.120000 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc6045f8-921b-4547-b06a-d248c80f9aa7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:41.120486 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc6045f8-921b-4547-b06a-d248c80f9aa7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:41.121314 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc6045f8-921b-4547-b06a-d248c80f9aa7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:41.121914 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc6045f8-921b-4547-b06a-d248c80f9aa7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:41.290087 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cc6045f8-921b-4547-b06a-d248c80f9aa7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:41.300658 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cc6045f8-921b-4547-b06a-d248c80f9aa7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.194349 Nov 24 15:21:41.301335 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 153/279] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:41 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:41.425269 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ca83900f-9f39-421a-92d3-45c584835a15 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:41.425870 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ca83900f-9f39-421a-92d3-45c584835a15 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:41.439082 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca83900f-9f39-421a-92d3-45c584835a15 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:41.439082 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca83900f-9f39-421a-92d3-45c584835a15 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:41.440365 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca83900f-9f39-421a-92d3-45c584835a15 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:41.440365 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca83900f-9f39-421a-92d3-45c584835a15 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:41.620860 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a831bf8f-987a-4012-b4f0-5c5bbb48725e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:41.622335 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a831bf8f-987a-4012-b4f0-5c5bbb48725e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:41.632436 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a831bf8f-987a-4012-b4f0-5c5bbb48725e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:41.633062 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a831bf8f-987a-4012-b4f0-5c5bbb48725e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:41.634065 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a831bf8f-987a-4012-b4f0-5c5bbb48725e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:41.634705 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a831bf8f-987a-4012-b4f0-5c5bbb48725e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:41.635868 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ca83900f-9f39-421a-92d3-45c584835a15 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:41.644090 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ca83900f-9f39-421a-92d3-45c584835a15 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1516 microversion: 2.1 time: 0.222347 Nov 24 15:21:41.651163 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 127/280] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:41 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1516 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:41.820989 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a831bf8f-987a-4012-b4f0-5c5bbb48725e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:41.828424 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a831bf8f-987a-4012-b4f0-5c5bbb48725e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1313 microversion: 2.1 time: 0.215448 Nov 24 15:21:41.829001 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 154/281] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:41 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:42.028239 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-bbb68100-f533-4716-8852-cce7c34a6f6f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:42.029945 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-bbb68100-f533-4716-8852-cce7c34a6f6f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:42.045586 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bbb68100-f533-4716-8852-cce7c34a6f6f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:42.046723 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bbb68100-f533-4716-8852-cce7c34a6f6f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:42.047862 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bbb68100-f533-4716-8852-cce7c34a6f6f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:42.048462 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bbb68100-f533-4716-8852-cce7c34a6f6f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:42.159135 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-bbb68100-f533-4716-8852-cce7c34a6f6f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:42.172334 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-bbb68100-f533-4716-8852-cce7c34a6f6f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1211 microversion: 2.1 time: 0.151145 Nov 24 15:21:42.173190 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 128/282] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:42 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1211 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:42.323367 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a1d86425-2c7f-4c80-bc42-7cb7304cde6a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:42.324237 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a1d86425-2c7f-4c80-bc42-7cb7304cde6a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:42.332904 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1d86425-2c7f-4c80-bc42-7cb7304cde6a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:42.333610 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1d86425-2c7f-4c80-bc42-7cb7304cde6a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:42.334555 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1d86425-2c7f-4c80-bc42-7cb7304cde6a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:42.335472 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a1d86425-2c7f-4c80-bc42-7cb7304cde6a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:42.503315 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a1d86425-2c7f-4c80-bc42-7cb7304cde6a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:42.511525 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a1d86425-2c7f-4c80-bc42-7cb7304cde6a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.194114 Nov 24 15:21:42.512089 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 155/283] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:42 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:42.845096 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6dc0e7e2-d295-4f41-8bbd-408e0d5addee tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:42.845761 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6dc0e7e2-d295-4f41-8bbd-408e0d5addee tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:42.851527 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6dc0e7e2-d295-4f41-8bbd-408e0d5addee tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:42.851969 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6dc0e7e2-d295-4f41-8bbd-408e0d5addee tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:42.852733 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6dc0e7e2-d295-4f41-8bbd-408e0d5addee tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:42.853154 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6dc0e7e2-d295-4f41-8bbd-408e0d5addee tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:43.023701 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6dc0e7e2-d295-4f41-8bbd-408e0d5addee tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:43.034398 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6dc0e7e2-d295-4f41-8bbd-408e0d5addee tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1496 microversion: 2.1 time: 0.192843 Nov 24 15:21:43.035012 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 129/284] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:42 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1496 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:43.189278 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1429aaa1-6134-4375-a719-cd21d3e836e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:43.189875 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1429aaa1-6134-4375-a719-cd21d3e836e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:43.196264 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1429aaa1-6134-4375-a719-cd21d3e836e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:43.196725 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1429aaa1-6134-4375-a719-cd21d3e836e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:43.197514 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1429aaa1-6134-4375-a719-cd21d3e836e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:43.197954 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1429aaa1-6134-4375-a719-cd21d3e836e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:43.331846 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1429aaa1-6134-4375-a719-cd21d3e836e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:43.338978 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1429aaa1-6134-4375-a719-cd21d3e836e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1279 microversion: 2.1 time: 0.153425 Nov 24 15:21:43.339541 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 156/285] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:43 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1279 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:43.530409 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8474471d-5522-4cb4-b71c-a9bd6b12c2cf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:43.530961 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8474471d-5522-4cb4-b71c-a9bd6b12c2cf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:43.537228 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8474471d-5522-4cb4-b71c-a9bd6b12c2cf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:43.537669 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8474471d-5522-4cb4-b71c-a9bd6b12c2cf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:43.538439 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8474471d-5522-4cb4-b71c-a9bd6b12c2cf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:43.538894 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8474471d-5522-4cb4-b71c-a9bd6b12c2cf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:43.666246 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8474471d-5522-4cb4-b71c-a9bd6b12c2cf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:43.673972 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8474471d-5522-4cb4-b71c-a9bd6b12c2cf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.147959 Nov 24 15:21:43.674539 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 130/286] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:43 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:44.356333 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1bcc4780-7208-42ba-a129-f0008e0d7342 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:44.357361 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1bcc4780-7208-42ba-a129-f0008e0d7342 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:44.363675 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1bcc4780-7208-42ba-a129-f0008e0d7342 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:44.364353 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1bcc4780-7208-42ba-a129-f0008e0d7342 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:44.365130 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1bcc4780-7208-42ba-a129-f0008e0d7342 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:44.365560 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1bcc4780-7208-42ba-a129-f0008e0d7342 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:44.498553 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1bcc4780-7208-42ba-a129-f0008e0d7342 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:44.505803 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1bcc4780-7208-42ba-a129-f0008e0d7342 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1279 microversion: 2.1 time: 0.153267 Nov 24 15:21:44.506399 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 157/287] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:44 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1279 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:44.690940 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ec40d065-ffed-41bb-8e14-d9fb3fb3b1f5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:44.691453 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ec40d065-ffed-41bb-8e14-d9fb3fb3b1f5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:44.697716 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ec40d065-ffed-41bb-8e14-d9fb3fb3b1f5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:44.698162 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ec40d065-ffed-41bb-8e14-d9fb3fb3b1f5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:44.698964 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ec40d065-ffed-41bb-8e14-d9fb3fb3b1f5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:44.699402 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ec40d065-ffed-41bb-8e14-d9fb3fb3b1f5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:44.832095 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ec40d065-ffed-41bb-8e14-d9fb3fb3b1f5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:44.841913 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ec40d065-ffed-41bb-8e14-d9fb3fb3b1f5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.154174 Nov 24 15:21:44.842598 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 131/288] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:44 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:45.416937 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-1477eb18-0ae5-4ad5-8433-ab08a8534023 req-f15dc6c6-eaa4-4695-9e66-2b798ea5c996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a77d835-ce70-43fb-ab67-3b41127405d3", "tag": "1aaa1843-b387-4a3e-a5f5-e558eab342ed"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:45.418500 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:21:45.418500 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:21:45.425939 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1477eb18-0ae5-4ad5-8433-ab08a8534023 req-f15dc6c6-eaa4-4695-9e66-2b798ea5c996 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:45.426380 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1477eb18-0ae5-4ad5-8433-ab08a8534023 req-f15dc6c6-eaa4-4695-9e66-2b798ea5c996 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:45.438069 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-1477eb18-0ae5-4ad5-8433-ab08a8534023 req-f15dc6c6-eaa4-4695-9e66-2b798ea5c996 service nova] Creating event network-changed:1aaa1843-b387-4a3e-a5f5-e558eab342ed for instance 1a77d835-ce70-43fb-ab67-3b41127405d3 on hv-cinder-80403 Nov 24 15:21:45.443097 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-1477eb18-0ae5-4ad5-8433-ab08a8534023 req-f15dc6c6-eaa4-4695-9e66-2b798ea5c996 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029731 Nov 24 15:21:45.443680 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 158/289] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:21:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:21:45.521685 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-359de69c-a01a-429f-8051-c90d722601c5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:45.522635 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-359de69c-a01a-429f-8051-c90d722601c5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:45.528956 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-359de69c-a01a-429f-8051-c90d722601c5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:45.529579 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-359de69c-a01a-429f-8051-c90d722601c5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:45.530507 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-359de69c-a01a-429f-8051-c90d722601c5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:45.531135 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-359de69c-a01a-429f-8051-c90d722601c5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:45.667023 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-359de69c-a01a-429f-8051-c90d722601c5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:45.675589 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-359de69c-a01a-429f-8051-c90d722601c5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1279 microversion: 2.1 time: 0.157958 Nov 24 15:21:45.676153 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 132/290] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:45 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1279 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:45.859878 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fa06a074-0689-480d-9069-0e29428b3958 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:45.860577 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fa06a074-0689-480d-9069-0e29428b3958 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:45.868516 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa06a074-0689-480d-9069-0e29428b3958 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:45.869298 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa06a074-0689-480d-9069-0e29428b3958 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:45.870238 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa06a074-0689-480d-9069-0e29428b3958 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:45.870971 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa06a074-0689-480d-9069-0e29428b3958 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:45.983294 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b782733c-5e59-4aca-9290-a3100989dbfa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:45.985415 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b782733c-5e59-4aca-9290-a3100989dbfa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:46.000209 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b782733c-5e59-4aca-9290-a3100989dbfa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:46.004121 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b782733c-5e59-4aca-9290-a3100989dbfa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:46.005116 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b782733c-5e59-4aca-9290-a3100989dbfa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:46.006441 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b782733c-5e59-4aca-9290-a3100989dbfa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:46.027864 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fa06a074-0689-480d-9069-0e29428b3958 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:46.054304 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fa06a074-0689-480d-9069-0e29428b3958 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.198914 Nov 24 15:21:46.055833 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 159/291] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:45 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:46.163130 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-b782733c-5e59-4aca-9290-a3100989dbfa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:46.171341 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b782733c-5e59-4aca-9290-a3100989dbfa tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1516 microversion: 2.1 time: 0.192241 Nov 24 15:21:46.181792 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 133/292] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:45 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1516 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:46.190266 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cb40aba8-0cef-4958-8f3c-8e71e23b7301 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "08ae13e4-59e5-4b43-8803-e86ce60fbd7a"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:46.191870 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cb40aba8-0cef-4958-8f3c-8e71e23b7301 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:46.201850 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb40aba8-0cef-4958-8f3c-8e71e23b7301 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:46.202429 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb40aba8-0cef-4958-8f3c-8e71e23b7301 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:46.203300 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb40aba8-0cef-4958-8f3c-8e71e23b7301 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:46.203835 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb40aba8-0cef-4958-8f3c-8e71e23b7301 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:46.599287 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8f20581a-2aee-4d04-ab27-a6d560dbd4f1 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:46.600101 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8f20581a-2aee-4d04-ab27-a6d560dbd4f1 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:46.607543 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f20581a-2aee-4d04-ab27-a6d560dbd4f1 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:46.608228 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f20581a-2aee-4d04-ab27-a6d560dbd4f1 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:46.609472 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f20581a-2aee-4d04-ab27-a6d560dbd4f1 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:46.610069 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f20581a-2aee-4d04-ab27-a6d560dbd4f1 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:46.643123 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8f20581a-2aee-4d04-ab27-a6d560dbd4f1 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Going to try to terminate instance {{(pid=116073) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:21:46.759633 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cb40aba8-0cef-4958-8f3c-8e71e23b7301 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "POST /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.573427 Nov 24 15:21:46.760626 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 160/293] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Nov 24 15:21:46 2021] POST /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/os-volume_attachments => generated 194 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:21:46.797613 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8f20581a-2aee-4d04-ab27-a6d560dbd4f1 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "DELETE /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 204 len: 0 microversion: 2.1 time: 0.203082 Nov 24 15:21:46.799498 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 134/294] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:21:46 2021] DELETE /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:21:46.810777 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f90aff19-fb53-4eb2-b8dc-8dcf8c19b6cd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:46.811639 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-79522a14-070c-4a2a-a9da-ae134f95d044 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:46.812331 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f90aff19-fb53-4eb2-b8dc-8dcf8c19b6cd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:46.812447 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-79522a14-070c-4a2a-a9da-ae134f95d044 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:46.821273 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-79522a14-070c-4a2a-a9da-ae134f95d044 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:46.821720 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-79522a14-070c-4a2a-a9da-ae134f95d044 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:46.822561 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-79522a14-070c-4a2a-a9da-ae134f95d044 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:46.823365 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-79522a14-070c-4a2a-a9da-ae134f95d044 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:46.824566 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f90aff19-fb53-4eb2-b8dc-8dcf8c19b6cd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:46.825243 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f90aff19-fb53-4eb2-b8dc-8dcf8c19b6cd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:46.827732 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f90aff19-fb53-4eb2-b8dc-8dcf8c19b6cd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:46.828772 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f90aff19-fb53-4eb2-b8dc-8dcf8c19b6cd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:47.084209 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-79522a14-070c-4a2a-a9da-ae134f95d044 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:47.088868 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f90aff19-fb53-4eb2-b8dc-8dcf8c19b6cd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:47.092821 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-79522a14-070c-4a2a-a9da-ae134f95d044 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1502 microversion: 2.1 time: 0.287185 Nov 24 15:21:47.093767 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 135/295] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:46 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1502 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:47.097641 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ff9be0e8-650e-48e6-b720-058185f2feb0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:47.098248 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ff9be0e8-650e-48e6-b720-058185f2feb0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:47.106789 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f90aff19-fb53-4eb2-b8dc-8dcf8c19b6cd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1267 microversion: 2.1 time: 0.344017 Nov 24 15:21:47.115927 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 161/296] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:46 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1267 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:47.127367 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff9be0e8-650e-48e6-b720-058185f2feb0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:47.127764 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff9be0e8-650e-48e6-b720-058185f2feb0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:47.128561 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff9be0e8-650e-48e6-b720-058185f2feb0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:47.129165 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff9be0e8-650e-48e6-b720-058185f2feb0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:47.289608 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ff9be0e8-650e-48e6-b720-058185f2feb0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:47.297976 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ff9be0e8-650e-48e6-b720-058185f2feb0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.203485 Nov 24 15:21:47.298903 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 136/297] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:47 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:48.110860 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-01ef5de0-f1af-428c-9198-9566a638a1bb tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:48.112178 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-01ef5de0-f1af-428c-9198-9566a638a1bb tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:48.119577 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-01ef5de0-f1af-428c-9198-9566a638a1bb tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:48.120341 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-01ef5de0-f1af-428c-9198-9566a638a1bb tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:48.123549 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-01ef5de0-f1af-428c-9198-9566a638a1bb tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:48.124236 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-01ef5de0-f1af-428c-9198-9566a638a1bb tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:48.132319 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-088b1d87-6598-4c0e-a39e-4a117dd9ccce tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:48.132916 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-088b1d87-6598-4c0e-a39e-4a117dd9ccce tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:48.140228 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-088b1d87-6598-4c0e-a39e-4a117dd9ccce tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:48.141731 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-088b1d87-6598-4c0e-a39e-4a117dd9ccce tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:48.142917 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-088b1d87-6598-4c0e-a39e-4a117dd9ccce tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:48.145166 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-088b1d87-6598-4c0e-a39e-4a117dd9ccce tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:48.400531 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-01ef5de0-f1af-428c-9198-9566a638a1bb tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:48.410987 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-01ef5de0-f1af-428c-9198-9566a638a1bb tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1502 microversion: 2.1 time: 0.304550 Nov 24 15:21:48.411566 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 162/298] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:48 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1502 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:48.428497 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ee515e50-7ed4-47d5-8f87-aa690cfde86d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:48.429182 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ee515e50-7ed4-47d5-8f87-aa690cfde86d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:48.438386 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ee515e50-7ed4-47d5-8f87-aa690cfde86d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:48.441093 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ee515e50-7ed4-47d5-8f87-aa690cfde86d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:48.442052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ee515e50-7ed4-47d5-8f87-aa690cfde86d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:48.447658 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ee515e50-7ed4-47d5-8f87-aa690cfde86d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:48.448465 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-088b1d87-6598-4c0e-a39e-4a117dd9ccce tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:48.459640 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-088b1d87-6598-4c0e-a39e-4a117dd9ccce tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1267 microversion: 2.1 time: 0.330778 Nov 24 15:21:48.460878 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 137/299] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:48 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1267 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:48.611273 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ee515e50-7ed4-47d5-8f87-aa690cfde86d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:48.625140 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ee515e50-7ed4-47d5-8f87-aa690cfde86d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.212333 Nov 24 15:21:48.625719 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 163/300] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:48 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:49.432392 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-9415ad54-2eb7-40ce-8919-329da3b5da08 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:49.432392 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-9415ad54-2eb7-40ce-8919-329da3b5da08 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:49.436728 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9415ad54-2eb7-40ce-8919-329da3b5da08 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:49.437228 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9415ad54-2eb7-40ce-8919-329da3b5da08 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:49.438021 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9415ad54-2eb7-40ce-8919-329da3b5da08 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:49.438454 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9415ad54-2eb7-40ce-8919-329da3b5da08 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:49.477719 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9723ece5-6c15-494c-9b79-857d4206ff24 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:49.484067 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9723ece5-6c15-494c-9b79-857d4206ff24 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:49.486299 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9723ece5-6c15-494c-9b79-857d4206ff24 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:49.487163 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9723ece5-6c15-494c-9b79-857d4206ff24 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:49.488084 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9723ece5-6c15-494c-9b79-857d4206ff24 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:49.488508 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9723ece5-6c15-494c-9b79-857d4206ff24 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:49.614621 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-9415ad54-2eb7-40ce-8919-329da3b5da08 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:49.628512 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-9415ad54-2eb7-40ce-8919-329da3b5da08 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1502 microversion: 2.1 time: 0.202864 Nov 24 15:21:49.629270 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 138/301] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:49 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:49.643027 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-99976e4a-fd0c-41c7-a3aa-12687329fa28 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:49.644151 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-99976e4a-fd0c-41c7-a3aa-12687329fa28 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:49.651484 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-99976e4a-fd0c-41c7-a3aa-12687329fa28 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:49.652238 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-99976e4a-fd0c-41c7-a3aa-12687329fa28 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:49.653175 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-99976e4a-fd0c-41c7-a3aa-12687329fa28 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:49.653795 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-99976e4a-fd0c-41c7-a3aa-12687329fa28 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:49.677094 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9723ece5-6c15-494c-9b79-857d4206ff24 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:49.686274 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9723ece5-6c15-494c-9b79-857d4206ff24 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1267 microversion: 2.1 time: 0.212920 Nov 24 15:21:49.697417 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 164/302] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:49 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:49.816167 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-99976e4a-fd0c-41c7-a3aa-12687329fa28 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:49.823788 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-99976e4a-fd0c-41c7-a3aa-12687329fa28 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.184750 Nov 24 15:21:49.824356 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 139/303] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:49 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:50.647418 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8f090726-d9db-4edb-8fce-10a1ad210ff7 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:50.648038 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8f090726-d9db-4edb-8fce-10a1ad210ff7 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:50.654210 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8f090726-d9db-4edb-8fce-10a1ad210ff7 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:50.654656 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8f090726-d9db-4edb-8fce-10a1ad210ff7 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:50.655469 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8f090726-d9db-4edb-8fce-10a1ad210ff7 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:50.655904 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8f090726-d9db-4edb-8fce-10a1ad210ff7 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:50.704880 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-5c38ca01-44f4-4e8d-a2d3-54ea9197bebc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:50.706349 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-5c38ca01-44f4-4e8d-a2d3-54ea9197bebc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:50.715011 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c38ca01-44f4-4e8d-a2d3-54ea9197bebc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:50.715663 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c38ca01-44f4-4e8d-a2d3-54ea9197bebc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:50.717569 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c38ca01-44f4-4e8d-a2d3-54ea9197bebc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:50.718505 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c38ca01-44f4-4e8d-a2d3-54ea9197bebc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:50.821507 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8f090726-d9db-4edb-8fce-10a1ad210ff7 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:50.829348 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8f090726-d9db-4edb-8fce-10a1ad210ff7 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1502 microversion: 2.1 time: 0.185539 Nov 24 15:21:50.829916 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 165/304] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:50 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:50.840345 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8926a247-a854-4efa-89c4-6597f95b11ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:50.840953 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8926a247-a854-4efa-89c4-6597f95b11ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:50.847019 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8926a247-a854-4efa-89c4-6597f95b11ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:50.847465 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8926a247-a854-4efa-89c4-6597f95b11ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:50.848253 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8926a247-a854-4efa-89c4-6597f95b11ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:50.848688 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8926a247-a854-4efa-89c4-6597f95b11ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:50.899159 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-5c38ca01-44f4-4e8d-a2d3-54ea9197bebc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:50.906795 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-5c38ca01-44f4-4e8d-a2d3-54ea9197bebc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1267 microversion: 2.1 time: 0.205880 Nov 24 15:21:50.908059 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 140/305] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:50 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:50.985374 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8926a247-a854-4efa-89c4-6597f95b11ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:50.994257 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8926a247-a854-4efa-89c4-6597f95b11ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1721 microversion: 2.1 time: 0.157371 Nov 24 15:21:50.994835 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 166/306] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:50 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:51.851483 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4862b0d7-34b9-4575-8855-b301bbcb71a5 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:51.851483 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4862b0d7-34b9-4575-8855-b301bbcb71a5 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:51.860693 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4862b0d7-34b9-4575-8855-b301bbcb71a5 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:51.863674 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4862b0d7-34b9-4575-8855-b301bbcb71a5 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:51.864824 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4862b0d7-34b9-4575-8855-b301bbcb71a5 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:51.865271 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4862b0d7-34b9-4575-8855-b301bbcb71a5 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:51.926209 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a0a7c975-7704-429e-b02b-3e0d1460bccf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:51.927527 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a0a7c975-7704-429e-b02b-3e0d1460bccf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:51.939698 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a0a7c975-7704-429e-b02b-3e0d1460bccf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:51.940908 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a0a7c975-7704-429e-b02b-3e0d1460bccf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:51.942034 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a0a7c975-7704-429e-b02b-3e0d1460bccf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:51.942697 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a0a7c975-7704-429e-b02b-3e0d1460bccf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:51.958161 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4862b0d7-34b9-4575-8855-b301bbcb71a5 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:51.975788 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4862b0d7-34b9-4575-8855-b301bbcb71a5 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 200 len: 1460 microversion: 2.1 time: 0.128719 Nov 24 15:21:51.977965 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 141/307] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:51 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 1460 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:51.992145 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-1eb03cbc-a4ec-4854-a42d-9ab7c2a6e70a req-96e48035-9267-4e4f-ac6c-187cf12db5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb768cae-085e-4df1-9bf9-9ff9dc62da9c", "name": "network-vif-deleted", "tag": "346a622a-2a2d-47d6-a817-b82b31b249a0"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:51.996924 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:21:51.996924 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:21:52.013801 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-1eb03cbc-a4ec-4854-a42d-9ab7c2a6e70a req-96e48035-9267-4e4f-ac6c-187cf12db5a0 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:52.015115 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-1eb03cbc-a4ec-4854-a42d-9ab7c2a6e70a req-96e48035-9267-4e4f-ac6c-187cf12db5a0 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:52.031176 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-1eb03cbc-a4ec-4854-a42d-9ab7c2a6e70a req-96e48035-9267-4e4f-ac6c-187cf12db5a0 service nova] Creating event network-vif-deleted:346a622a-2a2d-47d6-a817-b82b31b249a0 for instance eb768cae-085e-4df1-9bf9-9ff9dc62da9c on hv-cinder-80403 Nov 24 15:21:52.038754 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-1eb03cbc-a4ec-4854-a42d-9ab7c2a6e70a req-96e48035-9267-4e4f-ac6c-187cf12db5a0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057992 Nov 24 15:21:52.040093 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 142/308] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:21:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:21:52.047034 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-80904873-8906-4230-ac36-5be44403bf17 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:52.048993 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-80904873-8906-4230-ac36-5be44403bf17 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:52.058085 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80904873-8906-4230-ac36-5be44403bf17 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:52.058762 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80904873-8906-4230-ac36-5be44403bf17 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:52.060503 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80904873-8906-4230-ac36-5be44403bf17 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:52.061345 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80904873-8906-4230-ac36-5be44403bf17 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:52.214173 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a0a7c975-7704-429e-b02b-3e0d1460bccf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:52.222927 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a0a7c975-7704-429e-b02b-3e0d1460bccf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1267 microversion: 2.1 time: 0.302218 Nov 24 15:21:52.223984 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 167/309] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:51 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1267 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:52.290358 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-80904873-8906-4230-ac36-5be44403bf17 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:52.298580 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-80904873-8906-4230-ac36-5be44403bf17 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1698 microversion: 2.1 time: 0.257061 Nov 24 15:21:52.299272 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 143/310] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:52 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1698 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:52.315761 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b3f8e039-45e8-46c2-a8e0-7ceee1131647 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:52.322176 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b3f8e039-45e8-46c2-a8e0-7ceee1131647 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:52.322699 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b3f8e039-45e8-46c2-a8e0-7ceee1131647 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:52.385167 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b3f8e039-45e8-46c2-a8e0-7ceee1131647 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Going to try to start instance {{(pid=116072) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 24 15:21:52.433905 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b3f8e039-45e8-46c2-a8e0-7ceee1131647 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 202 len: 0 microversion: 2.1 time: 0.121528 Nov 24 15:21:52.439965 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 168/311] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:21:52 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:21:52.445475 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-dfc2144e-1959-453b-852d-1095d558e11e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:52.445968 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-dfc2144e-1959-453b-852d-1095d558e11e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:52.455092 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dfc2144e-1959-453b-852d-1095d558e11e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:52.456126 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dfc2144e-1959-453b-852d-1095d558e11e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:52.457422 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dfc2144e-1959-453b-852d-1095d558e11e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:52.458152 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dfc2144e-1959-453b-852d-1095d558e11e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:52.696810 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-dfc2144e-1959-453b-852d-1095d558e11e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:52.706345 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-dfc2144e-1959-453b-852d-1095d558e11e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1707 microversion: 2.1 time: 0.265106 Nov 24 15:21:52.706956 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 144/312] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:52 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1707 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:52.994686 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a18efa5b-696c-46fb-89ca-794e6935ffcf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:52.995403 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a18efa5b-696c-46fb-89ca-794e6935ffcf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: eb768cae-085e-4df1-9bf9-9ff9dc62da9c] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:53.001399 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a18efa5b-696c-46fb-89ca-794e6935ffcf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:53.001896 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a18efa5b-696c-46fb-89ca-794e6935ffcf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:53.002671 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a18efa5b-696c-46fb-89ca-794e6935ffcf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:53.003195 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a18efa5b-696c-46fb-89ca-794e6935ffcf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:53.018896 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-a18efa5b-696c-46fb-89ca-794e6935ffcf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] HTTP exception thrown: Instance eb768cae-085e-4df1-9bf9-9ff9dc62da9c could not be found. Nov 24 15:21:53.019527 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a18efa5b-696c-46fb-89ca-794e6935ffcf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Returning 404 to user: Instance eb768cae-085e-4df1-9bf9-9ff9dc62da9c could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:21:53.020419 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a18efa5b-696c-46fb-89ca-794e6935ffcf tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c" status: 404 len: 111 microversion: 2.1 time: 0.030333 Nov 24 15:21:53.021157 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 169/313] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:52 2021] GET /compute/v2.1/servers/eb768cae-085e-4df1-9bf9-9ff9dc62da9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:21:53.150448 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-758380314", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452", "networks": [{"uuid": "c60d9449-ba6f-4d12-83b1-6f849f230180"}]}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:53.211153 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.network.neutron [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] validate_networks() for [('c60d9449-ba6f-4d12-83b1-6f849f230180', None, None, None, None, None)] {{(pid=116073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:21:53.241653 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b2f656c3-4c73-4881-82fa-7a3af1d91e03 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:53.242486 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b2f656c3-4c73-4881-82fa-7a3af1d91e03 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:53.249195 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b2f656c3-4c73-4881-82fa-7a3af1d91e03 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:53.249494 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b2f656c3-4c73-4881-82fa-7a3af1d91e03 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:53.250277 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b2f656c3-4c73-4881-82fa-7a3af1d91e03 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:53.251025 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b2f656c3-4c73-4881-82fa-7a3af1d91e03 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:53.487267 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b2f656c3-4c73-4881-82fa-7a3af1d91e03 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:53.498214 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b2f656c3-4c73-4881-82fa-7a3af1d91e03 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1267 microversion: 2.1 time: 0.260673 Nov 24 15:21:53.499553 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 170/314] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:53 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1267 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:53.724501 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5fe34a7f-1feb-4f56-ad61-1e63dc8f713a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:53.725033 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5fe34a7f-1feb-4f56-ad61-1e63dc8f713a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:53.729827 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Flavor limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:21:53.730653 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Image limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:21:53.731174 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Flavor pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:21:53.731634 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Image pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:21:53.732061 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:21:53.733256 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5fe34a7f-1feb-4f56-ad61-1e63dc8f713a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:53.734111 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5fe34a7f-1feb-4f56-ad61-1e63dc8f713a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:53.735486 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5fe34a7f-1feb-4f56-ad61-1e63dc8f713a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:53.735932 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5fe34a7f-1feb-4f56-ad61-1e63dc8f713a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:53.747767 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:53.748312 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:53.749232 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:53.749661 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:53.770398 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Getting quotas for project 47d3bc717a2e4d3f8a7eb27026602262. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:21:53.781464 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Getting quotas for user 96f595b5dbbd439f9f493e47141b4dfb and project 47d3bc717a2e4d3f8a7eb27026602262. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:21:53.796288 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Going to run 1 instances... {{(pid=116073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:21:53.798939 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:21:53.848550 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-36c15bfc-65ce-4f2d-bb20-3e30a07bd03e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702440 Nov 24 15:21:53.849385 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 145/315] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:21:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:21:53.860393 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2d208561-0e69-4457-8761-e53d7d3d084b tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:53.861363 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2d208561-0e69-4457-8761-e53d7d3d084b tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:53.949046 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5fe34a7f-1feb-4f56-ad61-1e63dc8f713a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:53.951173 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-2d208561-0e69-4457-8761-e53d7d3d084b tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:53.957988 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5fe34a7f-1feb-4f56-ad61-1e63dc8f713a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1707 microversion: 2.1 time: 0.237173 Nov 24 15:21:53.958603 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 171/316] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:53 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1707 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:53.970889 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2d208561-0e69-4457-8761-e53d7d3d084b tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 200 len: 1213 microversion: 2.1 time: 0.114974 Nov 24 15:21:53.972317 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 146/317] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:53 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:54.397096 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-347fcd60-96da-46c0-b88f-95da8802a358 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:54.398834 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-347fcd60-96da-46c0-b88f-95da8802a358 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:54.406247 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-347fcd60-96da-46c0-b88f-95da8802a358 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:54.406853 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-347fcd60-96da-46c0-b88f-95da8802a358 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:54.407900 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-347fcd60-96da-46c0-b88f-95da8802a358 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:54.408536 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-347fcd60-96da-46c0-b88f-95da8802a358 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:54.434924 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-347fcd60-96da-46c0-b88f-95da8802a358 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lazy-loading 'flavor' on Instance uuid 54c23d97-138c-40a2-9593-8896dfdb2650 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:21:54.515790 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4ff27caf-15b5-4476-a823-8ce320598dab tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:54.516385 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4ff27caf-15b5-4476-a823-8ce320598dab tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:54.527233 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4ff27caf-15b5-4476-a823-8ce320598dab tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:54.527881 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4ff27caf-15b5-4476-a823-8ce320598dab tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:54.528864 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4ff27caf-15b5-4476-a823-8ce320598dab tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:54.529591 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4ff27caf-15b5-4476-a823-8ce320598dab tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:54.616130 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-347fcd60-96da-46c0-b88f-95da8802a358 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "POST /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/action" status: 200 len: 32 microversion: 2.1 time: 0.222493 Nov 24 15:21:54.616819 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 172/318] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:21:54 2021] POST /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:21:54.627900 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4107f66d-da8f-4559-b021-5a0a483a409e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:54.629204 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4107f66d-da8f-4559-b021-5a0a483a409e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:54.640445 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4107f66d-da8f-4559-b021-5a0a483a409e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:54.640991 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4107f66d-da8f-4559-b021-5a0a483a409e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:54.642459 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4107f66d-da8f-4559-b021-5a0a483a409e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:54.642550 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4107f66d-da8f-4559-b021-5a0a483a409e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:54.717550 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4ff27caf-15b5-4476-a823-8ce320598dab tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:54.729298 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4ff27caf-15b5-4476-a823-8ce320598dab tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1267 microversion: 2.1 time: 0.218005 Nov 24 15:21:54.736032 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 147/319] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:54 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:54.980487 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6066fcc9-6061-41f0-ae27-0f2937055ebf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:54.982265 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6066fcc9-6061-41f0-ae27-0f2937055ebf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:54.996388 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6066fcc9-6061-41f0-ae27-0f2937055ebf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:54.998439 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6066fcc9-6061-41f0-ae27-0f2937055ebf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:55.000421 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6066fcc9-6061-41f0-ae27-0f2937055ebf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:55.001202 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6066fcc9-6061-41f0-ae27-0f2937055ebf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:55.040883 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4107f66d-da8f-4559-b021-5a0a483a409e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:55.058103 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4107f66d-da8f-4559-b021-5a0a483a409e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.432807 Nov 24 15:21:55.059786 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 173/320] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:54 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:55.067541 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3b5b9e67-0e48-483e-99cc-4f2ca4818e4c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:55.075869 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3b5b9e67-0e48-483e-99cc-4f2ca4818e4c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:55.089242 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3b5b9e67-0e48-483e-99cc-4f2ca4818e4c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:55.091413 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3b5b9e67-0e48-483e-99cc-4f2ca4818e4c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:55.093517 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3b5b9e67-0e48-483e-99cc-4f2ca4818e4c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:55.095406 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3b5b9e67-0e48-483e-99cc-4f2ca4818e4c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:55.265065 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3b5b9e67-0e48-483e-99cc-4f2ca4818e4c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:55.279948 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3b5b9e67-0e48-483e-99cc-4f2ca4818e4c tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 200 len: 1273 microversion: 2.1 time: 0.219037 Nov 24 15:21:55.280561 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 174/321] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:55 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 1273 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:55.334646 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6066fcc9-6061-41f0-ae27-0f2937055ebf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:55.348754 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6066fcc9-6061-41f0-ae27-0f2937055ebf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1711 microversion: 2.1 time: 0.375258 Nov 24 15:21:55.349796 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 148/322] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:54 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1711 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:55.753175 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f3005cee-6eab-4e39-ae56-07fc1734939e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:55.754376 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f3005cee-6eab-4e39-ae56-07fc1734939e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:55.767834 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3005cee-6eab-4e39-ae56-07fc1734939e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:55.768324 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3005cee-6eab-4e39-ae56-07fc1734939e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:55.769113 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3005cee-6eab-4e39-ae56-07fc1734939e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:55.769554 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f3005cee-6eab-4e39-ae56-07fc1734939e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:56.074442 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f3005cee-6eab-4e39-ae56-07fc1734939e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:56.076357 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-5df9c3ed-f9c3-4799-ba77-3d4fe8a54086 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:56.077967 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-5df9c3ed-f9c3-4799-ba77-3d4fe8a54086 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:56.087107 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f3005cee-6eab-4e39-ae56-07fc1734939e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1267 microversion: 2.1 time: 0.334875 Nov 24 15:21:56.088282 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 175/323] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:55 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1267 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:56.100942 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5df9c3ed-f9c3-4799-ba77-3d4fe8a54086 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:56.101421 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5df9c3ed-f9c3-4799-ba77-3d4fe8a54086 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:56.102264 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5df9c3ed-f9c3-4799-ba77-3d4fe8a54086 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:56.103023 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5df9c3ed-f9c3-4799-ba77-3d4fe8a54086 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:56.286711 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-5df9c3ed-f9c3-4799-ba77-3d4fe8a54086 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:56.296045 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-5df9c3ed-f9c3-4799-ba77-3d4fe8a54086 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.224415 Nov 24 15:21:56.296664 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 149/324] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:56 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:56.300997 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-870f1014-0796-439b-8e44-05c70e05ad92 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:56.301839 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-870f1014-0796-439b-8e44-05c70e05ad92 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:56.310073 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-870f1014-0796-439b-8e44-05c70e05ad92 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:56.312278 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-870f1014-0796-439b-8e44-05c70e05ad92 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:56.313638 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-870f1014-0796-439b-8e44-05c70e05ad92 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:56.314699 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-870f1014-0796-439b-8e44-05c70e05ad92 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:56.490568 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-870f1014-0796-439b-8e44-05c70e05ad92 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:56.499808 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-870f1014-0796-439b-8e44-05c70e05ad92 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 200 len: 1313 microversion: 2.1 time: 0.205364 Nov 24 15:21:56.500868 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 176/325] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:56 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:56.906610 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-7952d7e2-cb77-4b36-b477-8abd02e8460e req-c7a56819-1ad2-43a8-a2cf-dec09211d50c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a77d835-ce70-43fb-ab67-3b41127405d3", "name": "network-vif-plugged", "status": "completed", "tag": "1aaa1843-b387-4a3e-a5f5-e558eab342ed"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:56.912353 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:21:56.912353 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:21:56.939223 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-7952d7e2-cb77-4b36-b477-8abd02e8460e req-c7a56819-1ad2-43a8-a2cf-dec09211d50c service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:56.939665 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-7952d7e2-cb77-4b36-b477-8abd02e8460e req-c7a56819-1ad2-43a8-a2cf-dec09211d50c service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:56.979304 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-7952d7e2-cb77-4b36-b477-8abd02e8460e req-c7a56819-1ad2-43a8-a2cf-dec09211d50c service nova] Creating event network-vif-plugged:1aaa1843-b387-4a3e-a5f5-e558eab342ed for instance 1a77d835-ce70-43fb-ab67-3b41127405d3 on hv-cinder-80403 Nov 24 15:21:56.994221 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-7952d7e2-cb77-4b36-b477-8abd02e8460e req-c7a56819-1ad2-43a8-a2cf-dec09211d50c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098349 Nov 24 15:21:56.996122 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 150/326] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:21:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:21:57.107148 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0de56314-664b-4eaf-ae8c-21f2782f3bdb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:57.108700 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0de56314-664b-4eaf-ae8c-21f2782f3bdb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:57.115836 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0de56314-664b-4eaf-ae8c-21f2782f3bdb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:57.117089 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0de56314-664b-4eaf-ae8c-21f2782f3bdb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:57.118483 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0de56314-664b-4eaf-ae8c-21f2782f3bdb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:57.119104 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0de56314-664b-4eaf-ae8c-21f2782f3bdb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:57.235628 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-5b91d288-0260-4320-b11b-13eced490b98 req-24f1441b-3a93-4cfd-89e2-8a90401b0f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0217fcdc-06ea-4067-ae8a-3b0be804dff7", "tag": "978bc587-b596-4d27-b3ae-179fc2cd8025"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:21:57.237998 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:21:57.237998 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:21:57.259981 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-5b91d288-0260-4320-b11b-13eced490b98 req-24f1441b-3a93-4cfd-89e2-8a90401b0f76 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:57.260660 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-5b91d288-0260-4320-b11b-13eced490b98 req-24f1441b-3a93-4cfd-89e2-8a90401b0f76 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:57.291352 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-5b91d288-0260-4320-b11b-13eced490b98 req-24f1441b-3a93-4cfd-89e2-8a90401b0f76 service nova] Creating event network-changed:978bc587-b596-4d27-b3ae-179fc2cd8025 for instance 0217fcdc-06ea-4067-ae8a-3b0be804dff7 on hv-cinder-80403 Nov 24 15:21:57.303374 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-5b91d288-0260-4320-b11b-13eced490b98 req-24f1441b-3a93-4cfd-89e2-8a90401b0f76 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077060 Nov 24 15:21:57.307477 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 151/327] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:21:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:21:57.325617 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-75e32564-0617-4cfb-b3ac-ade16ecee74e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:57.326694 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-75e32564-0617-4cfb-b3ac-ade16ecee74e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:57.338364 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-75e32564-0617-4cfb-b3ac-ade16ecee74e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:57.342645 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-75e32564-0617-4cfb-b3ac-ade16ecee74e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:57.344062 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-75e32564-0617-4cfb-b3ac-ade16ecee74e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:57.351567 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-75e32564-0617-4cfb-b3ac-ade16ecee74e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:57.378362 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0de56314-664b-4eaf-ae8c-21f2782f3bdb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:57.389303 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0de56314-664b-4eaf-ae8c-21f2782f3bdb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1267 microversion: 2.1 time: 0.286236 Nov 24 15:21:57.392318 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 177/328] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:57 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1267 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:57.517549 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1ccdd4f8-7b72-4602-849e-573f4f92f338 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:57.520267 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1ccdd4f8-7b72-4602-849e-573f4f92f338 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:57.527949 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ccdd4f8-7b72-4602-849e-573f4f92f338 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:57.529927 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ccdd4f8-7b72-4602-849e-573f4f92f338 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:57.530999 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ccdd4f8-7b72-4602-849e-573f4f92f338 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:57.531692 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ccdd4f8-7b72-4602-849e-573f4f92f338 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:57.543116 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-75e32564-0617-4cfb-b3ac-ade16ecee74e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:57.552919 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-75e32564-0617-4cfb-b3ac-ade16ecee74e tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.243536 Nov 24 15:21:57.562682 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 152/329] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:57 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:57.793837 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1ccdd4f8-7b72-4602-849e-573f4f92f338 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:57.808903 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1ccdd4f8-7b72-4602-849e-573f4f92f338 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 200 len: 1313 microversion: 2.1 time: 0.294875 Nov 24 15:21:57.810355 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 178/330] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:57 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:58.408744 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8705bec6-cede-4ff5-8b73-04b6db266c02 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:58.410026 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8705bec6-cede-4ff5-8b73-04b6db266c02 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:58.418477 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8705bec6-cede-4ff5-8b73-04b6db266c02 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:58.419653 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8705bec6-cede-4ff5-8b73-04b6db266c02 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:58.420354 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8705bec6-cede-4ff5-8b73-04b6db266c02 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:58.420951 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8705bec6-cede-4ff5-8b73-04b6db266c02 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:58.573677 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6eae4db2-7681-4ebe-98c6-9946a81cfcf4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:58.575042 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6eae4db2-7681-4ebe-98c6-9946a81cfcf4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:58.593411 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6eae4db2-7681-4ebe-98c6-9946a81cfcf4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:58.594084 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6eae4db2-7681-4ebe-98c6-9946a81cfcf4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:58.597229 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6eae4db2-7681-4ebe-98c6-9946a81cfcf4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:58.597698 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6eae4db2-7681-4ebe-98c6-9946a81cfcf4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:58.722736 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8705bec6-cede-4ff5-8b73-04b6db266c02 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:58.736404 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8705bec6-cede-4ff5-8b73-04b6db266c02 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1267 microversion: 2.1 time: 0.329631 Nov 24 15:21:58.764683 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 153/331] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:58 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1267 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:58.829303 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-86829390-0e9c-447b-9c0f-1cd38150b2b8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:58.833421 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-86829390-0e9c-447b-9c0f-1cd38150b2b8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:58.847104 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6eae4db2-7681-4ebe-98c6-9946a81cfcf4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:58.858051 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6eae4db2-7681-4ebe-98c6-9946a81cfcf4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.286763 Nov 24 15:21:58.858051 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 179/332] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:58 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:58.858236 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-86829390-0e9c-447b-9c0f-1cd38150b2b8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:58.858236 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-86829390-0e9c-447b-9c0f-1cd38150b2b8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:58.858236 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-86829390-0e9c-447b-9c0f-1cd38150b2b8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:58.858236 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-86829390-0e9c-447b-9c0f-1cd38150b2b8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:59.137120 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-86829390-0e9c-447b-9c0f-1cd38150b2b8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:59.149026 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-86829390-0e9c-447b-9c0f-1cd38150b2b8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 200 len: 1313 microversion: 2.1 time: 0.325379 Nov 24 15:21:59.159850 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 154/333] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:58 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:21:59.767035 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9a76589c-b046-4923-80da-b2c13244260e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:59.767687 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9a76589c-b046-4923-80da-b2c13244260e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:59.773793 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9a76589c-b046-4923-80da-b2c13244260e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:59.774238 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9a76589c-b046-4923-80da-b2c13244260e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:59.775038 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9a76589c-b046-4923-80da-b2c13244260e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:59.775469 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9a76589c-b046-4923-80da-b2c13244260e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:59.870760 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-45d5ed6c-bb3c-4b82-9bb1-9eb8311d696c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:59.871557 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-45d5ed6c-bb3c-4b82-9bb1-9eb8311d696c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:59.878343 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-45d5ed6c-bb3c-4b82-9bb1-9eb8311d696c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:59.878797 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-45d5ed6c-bb3c-4b82-9bb1-9eb8311d696c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:59.879601 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-45d5ed6c-bb3c-4b82-9bb1-9eb8311d696c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:59.880038 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-45d5ed6c-bb3c-4b82-9bb1-9eb8311d696c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:59.907322 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9a76589c-b046-4923-80da-b2c13244260e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:21:59.916591 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9a76589c-b046-4923-80da-b2c13244260e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1453 microversion: 2.1 time: 0.153066 Nov 24 15:21:59.917539 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 180/334] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:59 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:21:59.935562 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-77a84a17-45b6-4e73-979d-4d5db8a34266 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:21:59.936232 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-77a84a17-45b6-4e73-979d-4d5db8a34266 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:21:59.942749 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77a84a17-45b6-4e73-979d-4d5db8a34266 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:59.943319 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77a84a17-45b6-4e73-979d-4d5db8a34266 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:21:59.944100 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77a84a17-45b6-4e73-979d-4d5db8a34266 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:21:59.944533 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77a84a17-45b6-4e73-979d-4d5db8a34266 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:00.052257 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-45d5ed6c-bb3c-4b82-9bb1-9eb8311d696c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:00.062286 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-45d5ed6c-bb3c-4b82-9bb1-9eb8311d696c tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.195151 Nov 24 15:22:00.063513 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 155/335] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:59 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:00.136816 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-77a84a17-45b6-4e73-979d-4d5db8a34266 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:00.144266 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-77a84a17-45b6-4e73-979d-4d5db8a34266 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1453 microversion: 2.1 time: 0.212910 Nov 24 15:22:00.144855 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 181/336] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:21:59 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1453 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:00.166524 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-db15ac5a-0671-452d-b440-535425d2a7a8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:00.167193 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-db15ac5a-0671-452d-b440-535425d2a7a8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:00.173730 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-db15ac5a-0671-452d-b440-535425d2a7a8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:00.174256 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-db15ac5a-0671-452d-b440-535425d2a7a8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:00.175081 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-db15ac5a-0671-452d-b440-535425d2a7a8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:00.175515 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-db15ac5a-0671-452d-b440-535425d2a7a8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:00.316398 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-db15ac5a-0671-452d-b440-535425d2a7a8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:00.324586 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-db15ac5a-0671-452d-b440-535425d2a7a8 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 200 len: 1313 microversion: 2.1 time: 0.161808 Nov 24 15:22:00.325203 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 156/337] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:00 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:00.572814 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1794943897", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452", "networks": [{"uuid": "ed93d9af-072f-4552-ba1e-667ff4d62fac"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:00.625118 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] validate_networks() for [('ed93d9af-072f-4552-ba1e-667ff4d62fac', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:22:01.015787 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:22:01.016378 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:22:01.016665 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:22:01.017101 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:22:01.017509 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:22:01.027330 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:01.027778 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:01.028677 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:01.029117 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:01.045429 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Getting quotas for project 043d05ede00543d285fddc5f601117c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:22:01.049306 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Getting quotas for user 1c4128eac441411e9114acc0b6395f17 and project 043d05ede00543d285fddc5f601117c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:22:01.060536 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:22:01.062923 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:22:01.081921 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-727143bc-4819-4870-bbb4-5836af62614d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:01.082456 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-727143bc-4819-4870-bbb4-5836af62614d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:01.089596 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-727143bc-4819-4870-bbb4-5836af62614d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:01.090049 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-727143bc-4819-4870-bbb4-5836af62614d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:01.090992 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-727143bc-4819-4870-bbb4-5836af62614d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:01.091481 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-727143bc-4819-4870-bbb4-5836af62614d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:01.110133 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6f907347-28b6-430b-bcc5-c570b79e719d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540963 Nov 24 15:22:01.110777 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 182/338] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:22:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:22:01.121498 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4e654645-cf30-4cb5-81b0-5ab9ac6f7f21 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:01.127305 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4e654645-cf30-4cb5-81b0-5ab9ac6f7f21 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:01.191613 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4e654645-cf30-4cb5-81b0-5ab9ac6f7f21 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:01.203196 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4e654645-cf30-4cb5-81b0-5ab9ac6f7f21 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 200 len: 1219 microversion: 2.1 time: 0.085158 Nov 24 15:22:01.205050 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 183/339] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:01 2021] GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:01.341899 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9ba86fed-8987-4586-a4ac-244035088cce tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:01.342408 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9ba86fed-8987-4586-a4ac-244035088cce tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:01.351780 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ba86fed-8987-4586-a4ac-244035088cce tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:01.352228 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ba86fed-8987-4586-a4ac-244035088cce tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:01.353029 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ba86fed-8987-4586-a4ac-244035088cce tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:01.353462 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ba86fed-8987-4586-a4ac-244035088cce tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:01.400348 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-727143bc-4819-4870-bbb4-5836af62614d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:01.409211 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-727143bc-4819-4870-bbb4-5836af62614d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.331963 Nov 24 15:22:01.409798 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 157/340] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:01 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:01.579830 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9ba86fed-8987-4586-a4ac-244035088cce tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:01.589380 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9ba86fed-8987-4586-a4ac-244035088cce tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 200 len: 1313 microversion: 2.1 time: 0.251387 Nov 24 15:22:01.590847 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 184/341] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:01 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:02.221492 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c855ceab-d094-4ef2-9e84-33473c381751 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:02.222384 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c855ceab-d094-4ef2-9e84-33473c381751 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:02.238256 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c855ceab-d094-4ef2-9e84-33473c381751 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:02.238256 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c855ceab-d094-4ef2-9e84-33473c381751 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:02.238256 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c855ceab-d094-4ef2-9e84-33473c381751 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:02.238256 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c855ceab-d094-4ef2-9e84-33473c381751 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:02.307108 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c855ceab-d094-4ef2-9e84-33473c381751 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:02.317508 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c855ceab-d094-4ef2-9e84-33473c381751 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 200 len: 1271 microversion: 2.1 time: 0.099529 Nov 24 15:22:02.318396 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 158/342] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:02 2021] GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:02.430968 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4dd68741-c059-4eb5-9bc7-5bc31be06a21 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:02.432388 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4dd68741-c059-4eb5-9bc7-5bc31be06a21 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:02.440304 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4dd68741-c059-4eb5-9bc7-5bc31be06a21 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:02.441017 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4dd68741-c059-4eb5-9bc7-5bc31be06a21 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:02.442978 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4dd68741-c059-4eb5-9bc7-5bc31be06a21 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:02.443679 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4dd68741-c059-4eb5-9bc7-5bc31be06a21 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:02.477379 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-a75834e9-9a0f-486e-b752-09c59fe59444 req-ab74bc3e-d9b8-4f90-8ca1-8097a3aad01e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a77d835-ce70-43fb-ab67-3b41127405d3", "tag": "1aaa1843-b387-4a3e-a5f5-e558eab342ed"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:02.480954 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:22:02.480954 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:22:02.498474 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-a75834e9-9a0f-486e-b752-09c59fe59444 req-ab74bc3e-d9b8-4f90-8ca1-8097a3aad01e service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:02.500681 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-a75834e9-9a0f-486e-b752-09c59fe59444 req-ab74bc3e-d9b8-4f90-8ca1-8097a3aad01e service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:02.524546 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-a75834e9-9a0f-486e-b752-09c59fe59444 req-ab74bc3e-d9b8-4f90-8ca1-8097a3aad01e service nova] Creating event network-changed:1aaa1843-b387-4a3e-a5f5-e558eab342ed for instance 1a77d835-ce70-43fb-ab67-3b41127405d3 on hv-cinder-80403 Nov 24 15:22:02.529759 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-a75834e9-9a0f-486e-b752-09c59fe59444 req-ab74bc3e-d9b8-4f90-8ca1-8097a3aad01e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058017 Nov 24 15:22:02.530979 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 159/343] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:22:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:22:02.607640 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-73957324-f482-453b-aaa4-0a19454a41aa tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:02.608790 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-73957324-f482-453b-aaa4-0a19454a41aa tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:02.615360 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-73957324-f482-453b-aaa4-0a19454a41aa tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:02.616095 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-73957324-f482-453b-aaa4-0a19454a41aa tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:02.617080 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-73957324-f482-453b-aaa4-0a19454a41aa tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:02.617727 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-73957324-f482-453b-aaa4-0a19454a41aa tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:02.652862 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4dd68741-c059-4eb5-9bc7-5bc31be06a21 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:02.661280 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4dd68741-c059-4eb5-9bc7-5bc31be06a21 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.235326 Nov 24 15:22:02.662436 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 185/344] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:02 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:02.783301 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-73957324-f482-453b-aaa4-0a19454a41aa tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:02.791531 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-73957324-f482-453b-aaa4-0a19454a41aa tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 200 len: 1313 microversion: 2.1 time: 0.187878 Nov 24 15:22:02.792355 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 160/345] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:02 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:02.888106 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-7f42a076-2338-4ecd-89f7-6cb7aec7f4ee req-1fe79320-7f9e-4540-b810-9867732441de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0217fcdc-06ea-4067-ae8a-3b0be804dff7", "name": "network-vif-plugged", "status": "completed", "tag": "978bc587-b596-4d27-b3ae-179fc2cd8025"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:02.890637 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:22:02.890637 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:22:02.900818 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7f42a076-2338-4ecd-89f7-6cb7aec7f4ee req-1fe79320-7f9e-4540-b810-9867732441de service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:02.901549 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7f42a076-2338-4ecd-89f7-6cb7aec7f4ee req-1fe79320-7f9e-4540-b810-9867732441de service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:02.916010 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-7f42a076-2338-4ecd-89f7-6cb7aec7f4ee req-1fe79320-7f9e-4540-b810-9867732441de service nova] Creating event network-vif-plugged:978bc587-b596-4d27-b3ae-179fc2cd8025 for instance 0217fcdc-06ea-4067-ae8a-3b0be804dff7 on hv-cinder-80403 Nov 24 15:22:02.924083 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-7f42a076-2338-4ecd-89f7-6cb7aec7f4ee req-1fe79320-7f9e-4540-b810-9867732441de service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039768 Nov 24 15:22:02.925386 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 186/346] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:22:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:22:03.311130 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2005023249", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-145177780", "security_groups": [{"name": "tempest-secgroup-smoke-1037648471"}], "networks": [{"uuid": "151822c0-1b1f-4b3e-8dfc-70638799aec7"}], "block_device_mapping_v2": [{"uuid": "0f32bebd-6831-4423-84bd-9b46ab28387e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:03.336686 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-30dc80be-f42e-4518-8440-dc8ceccedd57 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:03.337186 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-30dc80be-f42e-4518-8440-dc8ceccedd57 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:03.346479 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-30dc80be-f42e-4518-8440-dc8ceccedd57 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:03.346953 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-30dc80be-f42e-4518-8440-dc8ceccedd57 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:03.351985 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-30dc80be-f42e-4518-8440-dc8ceccedd57 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:03.352565 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-30dc80be-f42e-4518-8440-dc8ceccedd57 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:03.480904 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.network.neutron [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] validate_networks() for [('151822c0-1b1f-4b3e-8dfc-70638799aec7', None, None, None, None, None)] {{(pid=116073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:22:03.645784 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-30dc80be-f42e-4518-8440-dc8ceccedd57 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:03.655240 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-30dc80be-f42e-4518-8440-dc8ceccedd57 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 200 len: 1319 microversion: 2.1 time: 0.323479 Nov 24 15:22:03.667528 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 187/347] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:03 2021] GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:03.683369 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-14a48876-82a3-4f74-90b6-e24a710a1f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:03.685260 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-14a48876-82a3-4f74-90b6-e24a710a1f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:03.692380 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14a48876-82a3-4f74-90b6-e24a710a1f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:03.693175 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14a48876-82a3-4f74-90b6-e24a710a1f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:03.694192 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14a48876-82a3-4f74-90b6-e24a710a1f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:03.694902 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-14a48876-82a3-4f74-90b6-e24a710a1f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:03.983388 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-14a48876-82a3-4f74-90b6-e24a710a1f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:03.992053 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-14a48876-82a3-4f74-90b6-e24a710a1f17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.318213 Nov 24 15:22:03.992619 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 188/348] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:03 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:03.998157 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-55d4b6c2-83b1-467e-97ef-6849021e75dc tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:03.999109 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-55d4b6c2-83b1-467e-97ef-6849021e75dc tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:04.005508 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55d4b6c2-83b1-467e-97ef-6849021e75dc tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:04.006077 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55d4b6c2-83b1-467e-97ef-6849021e75dc tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:04.006966 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55d4b6c2-83b1-467e-97ef-6849021e75dc tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:04.007468 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55d4b6c2-83b1-467e-97ef-6849021e75dc tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:04.113014 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Flavor limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:22:04.113522 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Image limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:22:04.114294 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Flavor pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:22:04.115049 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Image pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:22:04.115474 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:22:04.126592 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:04.127338 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:04.128401 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:04.128835 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:04.147674 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Getting quotas for project a89a75844197496785d27fd3e412344c. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:22:04.152344 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Getting quotas for user 2fbd637c599f4ba6ba3fa26a892c02a1 and project a89a75844197496785d27fd3e412344c. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:22:04.221199 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Going to run 1 instances... {{(pid=116073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:22:04.223386 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f32bebd-6831-4423-84bd-9b46ab28387e',volume_size=None,volume_type=None)] {{(pid=116073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:22:04.339212 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-55d4b6c2-83b1-467e-97ef-6849021e75dc tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:04.347242 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-55d4b6c2-83b1-467e-97ef-6849021e75dc tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 200 len: 1313 microversion: 2.1 time: 0.352813 Nov 24 15:22:04.347815 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 189/349] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:03 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:04.388349 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2db7c117-dcc8-4548-9fc1-85a1f3560a3d tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.081272 Nov 24 15:22:04.390581 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 161/350] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:22:03 2021] POST /compute/v2.1/servers => generated 406 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:22:04.399850 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-279562c9-e93c-4fd1-82c8-2538da5cbaa0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:04.400364 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-279562c9-e93c-4fd1-82c8-2538da5cbaa0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:04.492048 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-279562c9-e93c-4fd1-82c8-2538da5cbaa0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:04.507711 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-279562c9-e93c-4fd1-82c8-2538da5cbaa0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1088 microversion: 2.1 time: 0.111423 Nov 24 15:22:04.508456 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 190/351] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:04 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1088 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:04.575786 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-c215384b-8bf0-496d-86d0-e22b2f3cfee4 req-736d9b1a-b2df-428b-80ec-21a6c99c8445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "958aee3d-9b1b-4c27-8793-9e280bd9b6d2", "tag": "66c8ad52-c206-4ee5-aada-df62148b7eb9"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:04.577323 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:22:04.577323 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:22:04.597132 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-c215384b-8bf0-496d-86d0-e22b2f3cfee4 req-736d9b1a-b2df-428b-80ec-21a6c99c8445 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:04.597575 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-c215384b-8bf0-496d-86d0-e22b2f3cfee4 req-736d9b1a-b2df-428b-80ec-21a6c99c8445 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:04.619045 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-c215384b-8bf0-496d-86d0-e22b2f3cfee4 req-736d9b1a-b2df-428b-80ec-21a6c99c8445 service nova] Creating event network-changed:66c8ad52-c206-4ee5-aada-df62148b7eb9 for instance 958aee3d-9b1b-4c27-8793-9e280bd9b6d2 on hv-cinder-80403 Nov 24 15:22:04.625635 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-c215384b-8bf0-496d-86d0-e22b2f3cfee4 req-736d9b1a-b2df-428b-80ec-21a6c99c8445 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055833 Nov 24 15:22:04.626832 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 162/352] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:22:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:22:04.675207 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-38a3868d-d576-4c3b-badb-9b427c89b06c tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:04.676592 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-38a3868d-d576-4c3b-badb-9b427c89b06c tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:04.684165 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38a3868d-d576-4c3b-badb-9b427c89b06c tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:04.684852 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38a3868d-d576-4c3b-badb-9b427c89b06c tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:04.686721 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38a3868d-d576-4c3b-badb-9b427c89b06c tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:04.687457 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38a3868d-d576-4c3b-badb-9b427c89b06c tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:04.864354 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-38a3868d-d576-4c3b-badb-9b427c89b06c tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:04.875983 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-38a3868d-d576-4c3b-badb-9b427c89b06c tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 200 len: 1319 microversion: 2.1 time: 0.204874 Nov 24 15:22:04.877083 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 191/353] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:04 2021] GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:05.011798 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-bab0e8d0-0a93-462c-8c34-5ba1214106c7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:05.012720 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-bab0e8d0-0a93-462c-8c34-5ba1214106c7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:05.020338 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bab0e8d0-0a93-462c-8c34-5ba1214106c7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:05.020784 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bab0e8d0-0a93-462c-8c34-5ba1214106c7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:05.021751 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bab0e8d0-0a93-462c-8c34-5ba1214106c7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:05.022187 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bab0e8d0-0a93-462c-8c34-5ba1214106c7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:05.177885 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-bab0e8d0-0a93-462c-8c34-5ba1214106c7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:05.187063 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-bab0e8d0-0a93-462c-8c34-5ba1214106c7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.180225 Nov 24 15:22:05.187695 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 163/354] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:05 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:05.365580 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7c46b774-86fb-48e1-9952-4a60ba705196 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:05.366490 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7c46b774-86fb-48e1-9952-4a60ba705196 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:05.372918 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7c46b774-86fb-48e1-9952-4a60ba705196 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:05.373368 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7c46b774-86fb-48e1-9952-4a60ba705196 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:05.374219 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7c46b774-86fb-48e1-9952-4a60ba705196 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:05.374574 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7c46b774-86fb-48e1-9952-4a60ba705196 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:05.518300 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7c46b774-86fb-48e1-9952-4a60ba705196 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:05.525800 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7c46b774-86fb-48e1-9952-4a60ba705196 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 200 len: 1496 microversion: 2.1 time: 0.164238 Nov 24 15:22:05.526364 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 192/355] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:05 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 1496 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:05.532642 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6dd92974-9a2b-4a66-a86e-e72f55cea2a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:05.534652 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6dd92974-9a2b-4a66-a86e-e72f55cea2a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:05.541961 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6dd92974-9a2b-4a66-a86e-e72f55cea2a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:05.542563 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6dd92974-9a2b-4a66-a86e-e72f55cea2a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:05.543896 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6dd92974-9a2b-4a66-a86e-e72f55cea2a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:05.544377 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6dd92974-9a2b-4a66-a86e-e72f55cea2a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:05.623047 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6dd92974-9a2b-4a66-a86e-e72f55cea2a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:05.638487 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6dd92974-9a2b-4a66-a86e-e72f55cea2a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1186 microversion: 2.1 time: 0.115397 Nov 24 15:22:05.639107 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 164/356] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:05 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1186 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:05.894533 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bb102dfd-3f03-47c4-8923-365fd51fbdf6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:05.895900 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bb102dfd-3f03-47c4-8923-365fd51fbdf6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:05.907676 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bb102dfd-3f03-47c4-8923-365fd51fbdf6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:05.908300 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bb102dfd-3f03-47c4-8923-365fd51fbdf6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:05.909178 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bb102dfd-3f03-47c4-8923-365fd51fbdf6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:05.909714 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bb102dfd-3f03-47c4-8923-365fd51fbdf6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:06.071404 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bb102dfd-3f03-47c4-8923-365fd51fbdf6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:06.079008 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bb102dfd-3f03-47c4-8923-365fd51fbdf6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 200 len: 1319 microversion: 2.1 time: 0.188601 Nov 24 15:22:06.088756 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 193/357] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:05 2021] GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:06.170320 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-346cf82b-69bc-4175-b36c-841d956d8461 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:06.170840 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-346cf82b-69bc-4175-b36c-841d956d8461 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:06.176770 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-346cf82b-69bc-4175-b36c-841d956d8461 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:06.177434 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-346cf82b-69bc-4175-b36c-841d956d8461 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:06.178378 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-346cf82b-69bc-4175-b36c-841d956d8461 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:06.178834 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-346cf82b-69bc-4175-b36c-841d956d8461 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:06.207603 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-274da70d-9d01-4e72-8450-54d37fe483a0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:06.208613 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-274da70d-9d01-4e72-8450-54d37fe483a0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:06.210766 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-346cf82b-69bc-4175-b36c-841d956d8461 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Going to try to terminate instance {{(pid=116073) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:22:06.221880 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-274da70d-9d01-4e72-8450-54d37fe483a0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:06.222401 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-274da70d-9d01-4e72-8450-54d37fe483a0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:06.224299 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-274da70d-9d01-4e72-8450-54d37fe483a0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:06.224799 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-274da70d-9d01-4e72-8450-54d37fe483a0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:06.310346 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-346cf82b-69bc-4175-b36c-841d956d8461 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 204 len: 0 microversion: 2.1 time: 0.143734 Nov 24 15:22:06.310973 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 165/358] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:22:06 2021] DELETE /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:22:06.319692 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b29f33c0-47cf-40c2-91ac-e8fd4dc40cc9 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:06.320613 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b29f33c0-47cf-40c2-91ac-e8fd4dc40cc9 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:06.327860 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b29f33c0-47cf-40c2-91ac-e8fd4dc40cc9 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:06.328496 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b29f33c0-47cf-40c2-91ac-e8fd4dc40cc9 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:06.329574 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b29f33c0-47cf-40c2-91ac-e8fd4dc40cc9 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:06.330011 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b29f33c0-47cf-40c2-91ac-e8fd4dc40cc9 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:06.415096 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-274da70d-9d01-4e72-8450-54d37fe483a0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:06.428187 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-274da70d-9d01-4e72-8450-54d37fe483a0 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.226578 Nov 24 15:22:06.440040 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 194/359] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:06 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:06.570113 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-b29f33c0-47cf-40c2-91ac-e8fd4dc40cc9 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:06.578635 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b29f33c0-47cf-40c2-91ac-e8fd4dc40cc9 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 200 len: 1502 microversion: 2.1 time: 0.263051 Nov 24 15:22:06.579036 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 166/360] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:06 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 1502 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:06.659428 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-26dae096-e074-40b1-af9a-9591906126b4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:06.660606 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-26dae096-e074-40b1-af9a-9591906126b4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:06.673745 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-26dae096-e074-40b1-af9a-9591906126b4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:06.674949 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-26dae096-e074-40b1-af9a-9591906126b4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:06.675777 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-26dae096-e074-40b1-af9a-9591906126b4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:06.676224 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-26dae096-e074-40b1-af9a-9591906126b4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:06.833490 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-26dae096-e074-40b1-af9a-9591906126b4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:06.842855 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-26dae096-e074-40b1-af9a-9591906126b4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1272 microversion: 2.1 time: 0.188707 Nov 24 15:22:06.843970 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 195/361] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:06 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1272 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:07.096872 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8d3ecb44-ea39-4c41-bb80-0d1c27bf963d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:07.097489 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8d3ecb44-ea39-4c41-bb80-0d1c27bf963d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:07.103498 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8d3ecb44-ea39-4c41-bb80-0d1c27bf963d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:07.103953 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8d3ecb44-ea39-4c41-bb80-0d1c27bf963d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:07.104742 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8d3ecb44-ea39-4c41-bb80-0d1c27bf963d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:07.105360 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8d3ecb44-ea39-4c41-bb80-0d1c27bf963d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:07.267646 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8d3ecb44-ea39-4c41-bb80-0d1c27bf963d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:07.275401 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8d3ecb44-ea39-4c41-bb80-0d1c27bf963d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 200 len: 1319 microversion: 2.1 time: 0.182608 Nov 24 15:22:07.276073 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 167/362] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:07 2021] GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:07.334725 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-5a6e1a63-c795-44f1-bf0e-3fbf4c1f60d6 req-50c67278-2f05-4770-b9f8-690adfb761f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97e7745-6b55-46b5-a651-17bc3a3bdbc9", "tag": "00062239-b32a-4c2a-9fb5-f6a38539f917"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:07.338351 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:22:07.338351 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:22:07.346503 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-5a6e1a63-c795-44f1-bf0e-3fbf4c1f60d6 req-50c67278-2f05-4770-b9f8-690adfb761f1 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:07.347050 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-5a6e1a63-c795-44f1-bf0e-3fbf4c1f60d6 req-50c67278-2f05-4770-b9f8-690adfb761f1 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:07.360548 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-5a6e1a63-c795-44f1-bf0e-3fbf4c1f60d6 req-50c67278-2f05-4770-b9f8-690adfb761f1 service nova] Creating event network-changed:00062239-b32a-4c2a-9fb5-f6a38539f917 for instance b97e7745-6b55-46b5-a651-17bc3a3bdbc9 on hv-cinder-80403 Nov 24 15:22:07.366003 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-5a6e1a63-c795-44f1-bf0e-3fbf4c1f60d6 req-50c67278-2f05-4770-b9f8-690adfb761f1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035123 Nov 24 15:22:07.367154 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 196/363] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:22:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:22:07.445868 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ee2103ca-4b17-44f3-8f98-975cb9db55ca tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:07.446976 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ee2103ca-4b17-44f3-8f98-975cb9db55ca tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:07.453761 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ee2103ca-4b17-44f3-8f98-975cb9db55ca tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:07.454565 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ee2103ca-4b17-44f3-8f98-975cb9db55ca tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:07.455636 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ee2103ca-4b17-44f3-8f98-975cb9db55ca tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:07.456539 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ee2103ca-4b17-44f3-8f98-975cb9db55ca tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:07.595910 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9864aec7-62b1-401e-9af7-5f8b83f74121 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:07.596775 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9864aec7-62b1-401e-9af7-5f8b83f74121 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:07.603488 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9864aec7-62b1-401e-9af7-5f8b83f74121 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:07.603488 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9864aec7-62b1-401e-9af7-5f8b83f74121 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:07.604435 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9864aec7-62b1-401e-9af7-5f8b83f74121 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:07.604946 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9864aec7-62b1-401e-9af7-5f8b83f74121 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:07.606421 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ee2103ca-4b17-44f3-8f98-975cb9db55ca tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:07.615066 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ee2103ca-4b17-44f3-8f98-975cb9db55ca tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.172697 Nov 24 15:22:07.615634 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 168/364] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:07 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:07.742894 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9864aec7-62b1-401e-9af7-5f8b83f74121 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:07.751213 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9864aec7-62b1-401e-9af7-5f8b83f74121 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 200 len: 1502 microversion: 2.1 time: 0.159241 Nov 24 15:22:07.751781 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 197/365] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:07 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:07.865544 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-74ba9583-e8f4-4684-ac8a-8f95238f9120 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:07.866103 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-74ba9583-e8f4-4684-ac8a-8f95238f9120 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:07.872026 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-74ba9583-e8f4-4684-ac8a-8f95238f9120 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:07.872472 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-74ba9583-e8f4-4684-ac8a-8f95238f9120 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:07.873295 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-74ba9583-e8f4-4684-ac8a-8f95238f9120 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:07.873726 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-74ba9583-e8f4-4684-ac8a-8f95238f9120 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:08.017402 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-74ba9583-e8f4-4684-ac8a-8f95238f9120 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:08.024967 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-74ba9583-e8f4-4684-ac8a-8f95238f9120 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1260 microversion: 2.1 time: 0.163262 Nov 24 15:22:08.025623 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 169/366] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:07 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:08.291462 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b38eb45f-83fe-473c-b287-e8a14d4a7592 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:08.292213 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b38eb45f-83fe-473c-b287-e8a14d4a7592 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:08.298105 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b38eb45f-83fe-473c-b287-e8a14d4a7592 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:08.298561 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b38eb45f-83fe-473c-b287-e8a14d4a7592 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:08.299380 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b38eb45f-83fe-473c-b287-e8a14d4a7592 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:08.299819 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b38eb45f-83fe-473c-b287-e8a14d4a7592 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:08.431049 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b38eb45f-83fe-473c-b287-e8a14d4a7592 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:08.439430 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b38eb45f-83fe-473c-b287-e8a14d4a7592 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 200 len: 1319 microversion: 2.1 time: 0.151537 Nov 24 15:22:08.440019 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 198/367] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:08 2021] GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:08.632636 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-95ea7abc-0e63-4f4a-9388-a879118d8395 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:08.633151 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-95ea7abc-0e63-4f4a-9388-a879118d8395 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:08.640314 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-95ea7abc-0e63-4f4a-9388-a879118d8395 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:08.640765 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-95ea7abc-0e63-4f4a-9388-a879118d8395 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:08.641537 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-95ea7abc-0e63-4f4a-9388-a879118d8395 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:08.641975 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-95ea7abc-0e63-4f4a-9388-a879118d8395 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:08.770154 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-26749493-234c-4379-ab51-8d91909e6da3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:08.770770 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-26749493-234c-4379-ab51-8d91909e6da3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:08.774929 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-95ea7abc-0e63-4f4a-9388-a879118d8395 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:08.776569 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-26749493-234c-4379-ab51-8d91909e6da3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:08.777884 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-26749493-234c-4379-ab51-8d91909e6da3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:08.779011 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-26749493-234c-4379-ab51-8d91909e6da3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:08.780303 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-26749493-234c-4379-ab51-8d91909e6da3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:08.783685 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-95ea7abc-0e63-4f4a-9388-a879118d8395 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.154739 Nov 24 15:22:08.790956 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 170/368] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:08 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:08.916045 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-26749493-234c-4379-ab51-8d91909e6da3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:08.924425 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-26749493-234c-4379-ab51-8d91909e6da3 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 200 len: 1502 microversion: 2.1 time: 0.158771 Nov 24 15:22:08.925353 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 199/369] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:08 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:09.042392 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-207b2355-5448-4454-9523-bedd041fc8b9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:09.043042 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-207b2355-5448-4454-9523-bedd041fc8b9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:09.049410 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-207b2355-5448-4454-9523-bedd041fc8b9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:09.049856 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-207b2355-5448-4454-9523-bedd041fc8b9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:09.050629 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-207b2355-5448-4454-9523-bedd041fc8b9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:09.051107 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-207b2355-5448-4454-9523-bedd041fc8b9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:09.179112 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-207b2355-5448-4454-9523-bedd041fc8b9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:09.187110 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-207b2355-5448-4454-9523-bedd041fc8b9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1260 microversion: 2.1 time: 0.148370 Nov 24 15:22:09.187671 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 171/370] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:09 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:09.388505 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-a77c25a2-ef31-42e2-82ae-0cbd542fcafd req-4d60de42-58b1-4b49-bc69-781123569a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0217fcdc-06ea-4067-ae8a-3b0be804dff7", "name": "network-vif-deleted", "tag": "978bc587-b596-4d27-b3ae-179fc2cd8025"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:09.390143 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:22:09.390143 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:22:09.397072 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-a77c25a2-ef31-42e2-82ae-0cbd542fcafd req-4d60de42-58b1-4b49-bc69-781123569a71 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:09.397504 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-a77c25a2-ef31-42e2-82ae-0cbd542fcafd req-4d60de42-58b1-4b49-bc69-781123569a71 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:09.408354 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-a77c25a2-ef31-42e2-82ae-0cbd542fcafd req-4d60de42-58b1-4b49-bc69-781123569a71 service nova] Creating event network-vif-deleted:978bc587-b596-4d27-b3ae-179fc2cd8025 for instance 0217fcdc-06ea-4067-ae8a-3b0be804dff7 on hv-cinder-80403 Nov 24 15:22:09.413128 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-a77c25a2-ef31-42e2-82ae-0cbd542fcafd req-4d60de42-58b1-4b49-bc69-781123569a71 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028404 Nov 24 15:22:09.413677 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 200/371] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:22:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:22:09.456286 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-220ac9b7-8ddb-4d3c-b54e-09f12c73e523 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:09.456918 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-220ac9b7-8ddb-4d3c-b54e-09f12c73e523 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:09.462833 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-220ac9b7-8ddb-4d3c-b54e-09f12c73e523 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:09.463297 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-220ac9b7-8ddb-4d3c-b54e-09f12c73e523 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:09.464064 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-220ac9b7-8ddb-4d3c-b54e-09f12c73e523 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:09.464497 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-220ac9b7-8ddb-4d3c-b54e-09f12c73e523 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:09.594602 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-220ac9b7-8ddb-4d3c-b54e-09f12c73e523 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:09.601835 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-220ac9b7-8ddb-4d3c-b54e-09f12c73e523 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 200 len: 1319 microversion: 2.1 time: 0.149216 Nov 24 15:22:09.602396 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 172/372] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:09 2021] GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:09.801777 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c388c7c5-c3b3-46be-880b-c5beb92bfb13 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:09.802466 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c388c7c5-c3b3-46be-880b-c5beb92bfb13 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:09.808927 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c388c7c5-c3b3-46be-880b-c5beb92bfb13 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:09.809369 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c388c7c5-c3b3-46be-880b-c5beb92bfb13 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:09.810187 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c388c7c5-c3b3-46be-880b-c5beb92bfb13 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:09.810616 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c388c7c5-c3b3-46be-880b-c5beb92bfb13 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:09.938518 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c388c7c5-c3b3-46be-880b-c5beb92bfb13 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:09.942075 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-80fc5ada-0b51-4e55-92b3-b4c468c2529f tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:09.942676 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-80fc5ada-0b51-4e55-92b3-b4c468c2529f tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:09.946539 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c388c7c5-c3b3-46be-880b-c5beb92bfb13 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.149086 Nov 24 15:22:09.947158 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 201/373] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:09 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:09.948930 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80fc5ada-0b51-4e55-92b3-b4c468c2529f tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:09.949897 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80fc5ada-0b51-4e55-92b3-b4c468c2529f tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:09.950685 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80fc5ada-0b51-4e55-92b3-b4c468c2529f tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:09.951155 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80fc5ada-0b51-4e55-92b3-b4c468c2529f tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:10.009214 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-80fc5ada-0b51-4e55-92b3-b4c468c2529f tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:10.016865 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-80fc5ada-0b51-4e55-92b3-b4c468c2529f tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 200 len: 1460 microversion: 2.1 time: 0.078328 Nov 24 15:22:10.017423 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 173/374] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:09 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 1460 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:10.204001 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d0ad37c7-18da-4a7d-9837-7aaec6ac8059 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:10.204609 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d0ad37c7-18da-4a7d-9837-7aaec6ac8059 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:10.210485 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d0ad37c7-18da-4a7d-9837-7aaec6ac8059 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:10.210973 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d0ad37c7-18da-4a7d-9837-7aaec6ac8059 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:10.211747 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d0ad37c7-18da-4a7d-9837-7aaec6ac8059 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:10.212180 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d0ad37c7-18da-4a7d-9837-7aaec6ac8059 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:10.352358 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d0ad37c7-18da-4a7d-9837-7aaec6ac8059 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:10.359666 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d0ad37c7-18da-4a7d-9837-7aaec6ac8059 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1260 microversion: 2.1 time: 0.159864 Nov 24 15:22:10.360234 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 202/375] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:10 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:10.424407 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-a8b27cc8-668f-4731-b306-7d6a28aec3a8 req-d374de5e-76b8-4eea-be1c-d954f6c0bd84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "958aee3d-9b1b-4c27-8793-9e280bd9b6d2", "name": "network-vif-plugged", "status": "completed", "tag": "66c8ad52-c206-4ee5-aada-df62148b7eb9"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:10.426064 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:22:10.426064 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:22:10.435197 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-a8b27cc8-668f-4731-b306-7d6a28aec3a8 req-d374de5e-76b8-4eea-be1c-d954f6c0bd84 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:10.435670 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-a8b27cc8-668f-4731-b306-7d6a28aec3a8 req-d374de5e-76b8-4eea-be1c-d954f6c0bd84 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:10.446890 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-a8b27cc8-668f-4731-b306-7d6a28aec3a8 req-d374de5e-76b8-4eea-be1c-d954f6c0bd84 service nova] Creating event network-vif-plugged:66c8ad52-c206-4ee5-aada-df62148b7eb9 for instance 958aee3d-9b1b-4c27-8793-9e280bd9b6d2 on hv-cinder-80403 Nov 24 15:22:10.452008 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-a8b27cc8-668f-4731-b306-7d6a28aec3a8 req-d374de5e-76b8-4eea-be1c-d954f6c0bd84 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031136 Nov 24 15:22:10.452621 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 174/376] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:22:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:22:10.619549 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8d20b07d-d8b3-4817-98a4-076207326189 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:10.620078 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8d20b07d-d8b3-4817-98a4-076207326189 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:10.626441 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d20b07d-d8b3-4817-98a4-076207326189 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:10.626922 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d20b07d-d8b3-4817-98a4-076207326189 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:10.627696 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d20b07d-d8b3-4817-98a4-076207326189 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:10.628127 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d20b07d-d8b3-4817-98a4-076207326189 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:10.755288 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8d20b07d-d8b3-4817-98a4-076207326189 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:10.762432 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8d20b07d-d8b3-4817-98a4-076207326189 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 200 len: 1319 microversion: 2.1 time: 0.146590 Nov 24 15:22:10.763029 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 203/377] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:10 2021] GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:10.963998 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-19fa7344-cac9-436e-8ca7-a795c806de37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:10.964629 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-19fa7344-cac9-436e-8ca7-a795c806de37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:10.971369 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-19fa7344-cac9-436e-8ca7-a795c806de37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:10.971821 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-19fa7344-cac9-436e-8ca7-a795c806de37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:10.972591 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-19fa7344-cac9-436e-8ca7-a795c806de37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:10.973026 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-19fa7344-cac9-436e-8ca7-a795c806de37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:11.033855 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e80bf883-a369-4fc8-a697-72168a05800e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:11.034462 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e80bf883-a369-4fc8-a697-72168a05800e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:11.040711 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e80bf883-a369-4fc8-a697-72168a05800e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:11.041159 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e80bf883-a369-4fc8-a697-72168a05800e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:11.041940 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e80bf883-a369-4fc8-a697-72168a05800e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:11.042369 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e80bf883-a369-4fc8-a697-72168a05800e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:11.111837 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e80bf883-a369-4fc8-a697-72168a05800e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96f595b5dbbd439f9f493e47141b4dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d3bc717a2e4d3f8a7eb27026602262', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:11.119220 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e80bf883-a369-4fc8-a697-72168a05800e tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 200 len: 1460 microversion: 2.1 time: 0.089060 Nov 24 15:22:11.119789 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 204/378] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:11 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 1460 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:11.128456 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-19fa7344-cac9-436e-8ca7-a795c806de37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:11.136461 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-19fa7344-cac9-436e-8ca7-a795c806de37 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.176975 Nov 24 15:22:11.137558 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 175/379] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:10 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:11.376612 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c7f93f04-cd47-42db-8a5f-033afa1a880f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:11.377223 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c7f93f04-cd47-42db-8a5f-033afa1a880f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:11.383572 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7f93f04-cd47-42db-8a5f-033afa1a880f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:11.384011 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7f93f04-cd47-42db-8a5f-033afa1a880f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:11.384823 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7f93f04-cd47-42db-8a5f-033afa1a880f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:11.385230 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c7f93f04-cd47-42db-8a5f-033afa1a880f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:11.520937 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c7f93f04-cd47-42db-8a5f-033afa1a880f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:11.528272 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c7f93f04-cd47-42db-8a5f-033afa1a880f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1260 microversion: 2.1 time: 0.155427 Nov 24 15:22:11.528840 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 205/380] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:11 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:11.779919 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-84404cb0-5178-43f1-a42f-37a2a2b66de6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:11.780516 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-84404cb0-5178-43f1-a42f-37a2a2b66de6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:11.786335 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-84404cb0-5178-43f1-a42f-37a2a2b66de6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:11.786781 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-84404cb0-5178-43f1-a42f-37a2a2b66de6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:11.787571 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-84404cb0-5178-43f1-a42f-37a2a2b66de6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:11.788007 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-84404cb0-5178-43f1-a42f-37a2a2b66de6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:11.923245 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-84404cb0-5178-43f1-a42f-37a2a2b66de6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:11.932659 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-84404cb0-5178-43f1-a42f-37a2a2b66de6 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 200 len: 1319 microversion: 2.1 time: 0.156600 Nov 24 15:22:11.933256 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 176/381] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:11 2021] GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:12.135923 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0a84c576-d81b-493f-b228-72e976723349 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:12.136534 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0a84c576-d81b-493f-b228-72e976723349 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] [instance: 0217fcdc-06ea-4067-ae8a-3b0be804dff7] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:12.143432 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0a84c576-d81b-493f-b228-72e976723349 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:12.143884 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0a84c576-d81b-493f-b228-72e976723349 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:12.144662 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0a84c576-d81b-493f-b228-72e976723349 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:12.145100 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0a84c576-d81b-493f-b228-72e976723349 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:12.154118 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4200d4c7-465b-4f72-919d-570b14c9ab17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:12.154716 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4200d4c7-465b-4f72-919d-570b14c9ab17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:12.159198 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-0a84c576-d81b-493f-b228-72e976723349 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] HTTP exception thrown: Instance 0217fcdc-06ea-4067-ae8a-3b0be804dff7 could not be found. Nov 24 15:22:12.159791 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0a84c576-d81b-493f-b228-72e976723349 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] Returning 404 to user: Instance 0217fcdc-06ea-4067-ae8a-3b0be804dff7 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:22:12.160613 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0a84c576-d81b-493f-b228-72e976723349 tempest-VolumesActionsTest-1002758033 tempest-VolumesActionsTest-1002758033-project] 10.222.0.66 "GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7" status: 404 len: 111 microversion: 2.1 time: 0.028376 Nov 24 15:22:12.160898 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4200d4c7-465b-4f72-919d-570b14c9ab17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:12.161148 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 206/382] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:12 2021] GET /compute/v2.1/servers/0217fcdc-06ea-4067-ae8a-3b0be804dff7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:22:12.161339 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4200d4c7-465b-4f72-919d-570b14c9ab17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:12.162178 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4200d4c7-465b-4f72-919d-570b14c9ab17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:12.162611 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4200d4c7-465b-4f72-919d-570b14c9ab17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:12.311397 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4200d4c7-465b-4f72-919d-570b14c9ab17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:12.320039 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4200d4c7-465b-4f72-919d-570b14c9ab17 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.170307 Nov 24 15:22:12.320684 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 177/383] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:12 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:12.545158 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-67b130d7-e027-4d11-abc3-6e7effc7b0bc tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:12.545828 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-67b130d7-e027-4d11-abc3-6e7effc7b0bc tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:12.552494 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-67b130d7-e027-4d11-abc3-6e7effc7b0bc tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:12.552944 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-67b130d7-e027-4d11-abc3-6e7effc7b0bc tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:12.553906 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-67b130d7-e027-4d11-abc3-6e7effc7b0bc tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:12.554370 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-67b130d7-e027-4d11-abc3-6e7effc7b0bc tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:12.696243 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-67b130d7-e027-4d11-abc3-6e7effc7b0bc tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:12.703763 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-67b130d7-e027-4d11-abc3-6e7effc7b0bc tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1260 microversion: 2.1 time: 0.162517 Nov 24 15:22:12.704325 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 207/384] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:12 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:12.949139 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c6d86492-90ec-4ee8-8237-582c46797250 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:12.949737 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c6d86492-90ec-4ee8-8237-582c46797250 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:12.955935 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c6d86492-90ec-4ee8-8237-582c46797250 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:12.956377 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c6d86492-90ec-4ee8-8237-582c46797250 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:12.957140 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c6d86492-90ec-4ee8-8237-582c46797250 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:12.957570 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c6d86492-90ec-4ee8-8237-582c46797250 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:13.085993 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c6d86492-90ec-4ee8-8237-582c46797250 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:13.093778 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c6d86492-90ec-4ee8-8237-582c46797250 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 200 len: 1507 microversion: 2.1 time: 0.148292 Nov 24 15:22:13.094338 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 178/385] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:12 2021] GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:13.338365 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2558754d-4d6c-40e7-a821-d1e09a17c6d9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:13.339129 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2558754d-4d6c-40e7-a821-d1e09a17c6d9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:13.345787 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2558754d-4d6c-40e7-a821-d1e09a17c6d9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:13.346232 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2558754d-4d6c-40e7-a821-d1e09a17c6d9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:13.347037 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2558754d-4d6c-40e7-a821-d1e09a17c6d9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:13.347470 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2558754d-4d6c-40e7-a821-d1e09a17c6d9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:13.514418 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2558754d-4d6c-40e7-a821-d1e09a17c6d9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:13.523527 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2558754d-4d6c-40e7-a821-d1e09a17c6d9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.188621 Nov 24 15:22:13.524322 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 208/386] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:13 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:13.720987 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-d241cd5c-1044-4a5f-b88a-27e766526926 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:13.721587 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-d241cd5c-1044-4a5f-b88a-27e766526926 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:13.727948 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d241cd5c-1044-4a5f-b88a-27e766526926 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:13.728386 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d241cd5c-1044-4a5f-b88a-27e766526926 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:13.729146 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d241cd5c-1044-4a5f-b88a-27e766526926 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:13.729569 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d241cd5c-1044-4a5f-b88a-27e766526926 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:13.861236 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-d241cd5c-1044-4a5f-b88a-27e766526926 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:13.868684 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-d241cd5c-1044-4a5f-b88a-27e766526926 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1260 microversion: 2.1 time: 0.151302 Nov 24 15:22:13.869244 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 179/387] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:13 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:14.541362 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7f723206-133c-4cf5-b436-82ceab8686c1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:14.541964 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7f723206-133c-4cf5-b436-82ceab8686c1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:14.549031 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f723206-133c-4cf5-b436-82ceab8686c1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:14.549481 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f723206-133c-4cf5-b436-82ceab8686c1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:14.550283 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f723206-133c-4cf5-b436-82ceab8686c1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:14.550715 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7f723206-133c-4cf5-b436-82ceab8686c1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:14.678497 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7f723206-133c-4cf5-b436-82ceab8686c1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:14.686326 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7f723206-133c-4cf5-b436-82ceab8686c1 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.148752 Nov 24 15:22:14.686898 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 209/388] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:14 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:14.885252 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-745369f7-9902-4a2b-8381-83f5c78f07ff tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:14.885785 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-745369f7-9902-4a2b-8381-83f5c78f07ff tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:14.892526 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-745369f7-9902-4a2b-8381-83f5c78f07ff tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:14.892968 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-745369f7-9902-4a2b-8381-83f5c78f07ff tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:14.893728 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-745369f7-9902-4a2b-8381-83f5c78f07ff tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:14.894158 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-745369f7-9902-4a2b-8381-83f5c78f07ff tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:15.036014 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-745369f7-9902-4a2b-8381-83f5c78f07ff tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:15.043231 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-745369f7-9902-4a2b-8381-83f5c78f07ff tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1260 microversion: 2.1 time: 0.161655 Nov 24 15:22:15.043798 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 180/389] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:14 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:15.702944 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-87d87943-f62b-4241-8a0c-6f2151813d32 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:15.703540 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-87d87943-f62b-4241-8a0c-6f2151813d32 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:15.709699 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-87d87943-f62b-4241-8a0c-6f2151813d32 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:15.710137 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-87d87943-f62b-4241-8a0c-6f2151813d32 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:15.710925 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-87d87943-f62b-4241-8a0c-6f2151813d32 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:15.711354 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-87d87943-f62b-4241-8a0c-6f2151813d32 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:15.837658 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-87d87943-f62b-4241-8a0c-6f2151813d32 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:15.845648 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-87d87943-f62b-4241-8a0c-6f2151813d32 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.146266 Nov 24 15:22:15.846202 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 210/390] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:15 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:16.059785 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-9c7366de-e7eb-47a7-8075-ee2c92dcc837 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:16.060391 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-9c7366de-e7eb-47a7-8075-ee2c92dcc837 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:16.066622 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9c7366de-e7eb-47a7-8075-ee2c92dcc837 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:16.067115 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9c7366de-e7eb-47a7-8075-ee2c92dcc837 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:16.067864 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9c7366de-e7eb-47a7-8075-ee2c92dcc837 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:16.068295 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9c7366de-e7eb-47a7-8075-ee2c92dcc837 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:16.202426 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-9c7366de-e7eb-47a7-8075-ee2c92dcc837 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:16.209979 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-9c7366de-e7eb-47a7-8075-ee2c92dcc837 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1260 microversion: 2.1 time: 0.153733 Nov 24 15:22:16.210681 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 181/391] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:16 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:16.862621 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-45fad07f-fa8e-4a0f-8560-91beb966e8fb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:16.863424 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-45fad07f-fa8e-4a0f-8560-91beb966e8fb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:16.870521 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45fad07f-fa8e-4a0f-8560-91beb966e8fb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:16.870959 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45fad07f-fa8e-4a0f-8560-91beb966e8fb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:16.872433 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45fad07f-fa8e-4a0f-8560-91beb966e8fb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:16.872849 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45fad07f-fa8e-4a0f-8560-91beb966e8fb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:17.007513 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-45fad07f-fa8e-4a0f-8560-91beb966e8fb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:17.015793 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-45fad07f-fa8e-4a0f-8560-91beb966e8fb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.156817 Nov 24 15:22:17.016351 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 211/392] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:16 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:17.227640 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3f35bac0-008f-4c13-9641-c4d8c6a46c7b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:17.228253 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3f35bac0-008f-4c13-9641-c4d8c6a46c7b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:17.235589 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f35bac0-008f-4c13-9641-c4d8c6a46c7b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:17.236035 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f35bac0-008f-4c13-9641-c4d8c6a46c7b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:17.236820 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f35bac0-008f-4c13-9641-c4d8c6a46c7b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:17.237252 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f35bac0-008f-4c13-9641-c4d8c6a46c7b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:17.375167 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-3f35bac0-008f-4c13-9641-c4d8c6a46c7b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:17.382416 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3f35bac0-008f-4c13-9641-c4d8c6a46c7b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1260 microversion: 2.1 time: 0.159033 Nov 24 15:22:17.383082 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 182/393] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:17 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:18.033351 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-56ba4381-3776-4613-99b3-198f22c02d39 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:18.034794 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-56ba4381-3776-4613-99b3-198f22c02d39 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:18.042104 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-56ba4381-3776-4613-99b3-198f22c02d39 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:18.042561 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-56ba4381-3776-4613-99b3-198f22c02d39 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:18.043724 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-56ba4381-3776-4613-99b3-198f22c02d39 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:18.044300 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-56ba4381-3776-4613-99b3-198f22c02d39 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:18.193283 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-56ba4381-3776-4613-99b3-198f22c02d39 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:18.203752 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-56ba4381-3776-4613-99b3-198f22c02d39 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.174081 Nov 24 15:22:18.204640 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 212/394] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:18 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:18.399582 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8874c527-f966-4b87-82d5-49c4ab9268a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:18.400818 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8874c527-f966-4b87-82d5-49c4ab9268a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:18.407205 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8874c527-f966-4b87-82d5-49c4ab9268a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:18.407647 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8874c527-f966-4b87-82d5-49c4ab9268a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:18.408600 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8874c527-f966-4b87-82d5-49c4ab9268a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:18.409217 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8874c527-f966-4b87-82d5-49c4ab9268a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:18.585026 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8874c527-f966-4b87-82d5-49c4ab9268a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:18.592483 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8874c527-f966-4b87-82d5-49c4ab9268a9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1260 microversion: 2.1 time: 0.196843 Nov 24 15:22:18.602740 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 183/395] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:18 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:19.221325 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-656bb52f-c578-4c5e-a0e3-fddf590b2801 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:19.221932 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-656bb52f-c578-4c5e-a0e3-fddf590b2801 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:19.229107 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-656bb52f-c578-4c5e-a0e3-fddf590b2801 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:19.229631 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-656bb52f-c578-4c5e-a0e3-fddf590b2801 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:19.230709 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-656bb52f-c578-4c5e-a0e3-fddf590b2801 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:19.231182 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-656bb52f-c578-4c5e-a0e3-fddf590b2801 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:19.400398 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-656bb52f-c578-4c5e-a0e3-fddf590b2801 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:19.417071 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-656bb52f-c578-4c5e-a0e3-fddf590b2801 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1568 microversion: 2.1 time: 0.199358 Nov 24 15:22:19.420876 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 213/396] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:19 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:19.610439 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-36abab6f-eeaf-42c0-8598-246e9f38c8a6 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:19.611233 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-36abab6f-eeaf-42c0-8598-246e9f38c8a6 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:19.617999 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-36abab6f-eeaf-42c0-8598-246e9f38c8a6 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:19.618470 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-36abab6f-eeaf-42c0-8598-246e9f38c8a6 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:19.619276 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-36abab6f-eeaf-42c0-8598-246e9f38c8a6 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:19.619862 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-36abab6f-eeaf-42c0-8598-246e9f38c8a6 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:19.770177 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-36abab6f-eeaf-42c0-8598-246e9f38c8a6 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:19.779363 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-36abab6f-eeaf-42c0-8598-246e9f38c8a6 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1260 microversion: 2.1 time: 0.172663 Nov 24 15:22:19.780230 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 184/397] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:19 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:20.436982 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-557b724f-330e-402d-9a85-c9a6f8dd9df3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:20.437501 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-557b724f-330e-402d-9a85-c9a6f8dd9df3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:20.444391 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-557b724f-330e-402d-9a85-c9a6f8dd9df3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:20.444834 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-557b724f-330e-402d-9a85-c9a6f8dd9df3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:20.445620 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-557b724f-330e-402d-9a85-c9a6f8dd9df3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:20.446048 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-557b724f-330e-402d-9a85-c9a6f8dd9df3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:20.598706 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-557b724f-330e-402d-9a85-c9a6f8dd9df3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:20.606510 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-557b724f-330e-402d-9a85-c9a6f8dd9df3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1548 microversion: 2.1 time: 0.173711 Nov 24 15:22:20.607208 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 214/398] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:20 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1548 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:20.623320 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b7453092-4e9e-4c9b-be96-e51d3629bd4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:20.623854 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b7453092-4e9e-4c9b-be96-e51d3629bd4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:20.630457 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b7453092-4e9e-4c9b-be96-e51d3629bd4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:20.630937 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b7453092-4e9e-4c9b-be96-e51d3629bd4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:20.631718 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b7453092-4e9e-4c9b-be96-e51d3629bd4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:20.632152 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b7453092-4e9e-4c9b-be96-e51d3629bd4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:20.756621 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-b7453092-4e9e-4c9b-be96-e51d3629bd4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] HTTP exception thrown: Cannot 'detach_volume' instance 54c23d97-138c-40a2-9593-8896dfdb2650 while it is in vm_state rescued Nov 24 15:22:20.757499 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b7453092-4e9e-4c9b-be96-e51d3629bd4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Returning 409 to user: Cannot 'detach_volume' instance 54c23d97-138c-40a2-9593-8896dfdb2650 while it is in vm_state rescued {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:22:20.758397 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b7453092-4e9e-4c9b-be96-e51d3629bd4f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "DELETE /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/os-volume_attachments/08ae13e4-59e5-4b43-8803-e86ce60fbd7a" status: 409 len: 152 microversion: 2.1 time: 0.139363 Nov 24 15:22:20.759050 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 185/399] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Nov 24 15:22:20 2021] DELETE /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/os-volume_attachments/08ae13e4-59e5-4b43-8803-e86ce60fbd7a => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 24 15:22:20.770129 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-38e5c6d0-4e5a-4754-b582-28ce4b719931 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:20.771617 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-38e5c6d0-4e5a-4754-b582-28ce4b719931 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:20.778283 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38e5c6d0-4e5a-4754-b582-28ce4b719931 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:20.779362 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38e5c6d0-4e5a-4754-b582-28ce4b719931 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:20.780695 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38e5c6d0-4e5a-4754-b582-28ce4b719931 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:20.781133 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38e5c6d0-4e5a-4754-b582-28ce4b719931 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:20.797245 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-1b4a25fa-60a9-412c-a26e-c36dafbe48f0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:20.798145 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-1b4a25fa-60a9-412c-a26e-c36dafbe48f0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:20.806581 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1b4a25fa-60a9-412c-a26e-c36dafbe48f0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:20.807062 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1b4a25fa-60a9-412c-a26e-c36dafbe48f0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:20.807855 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1b4a25fa-60a9-412c-a26e-c36dafbe48f0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:20.808291 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1b4a25fa-60a9-412c-a26e-c36dafbe48f0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:20.861633 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-38e5c6d0-4e5a-4754-b582-28ce4b719931 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "POST /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/action" status: 202 len: 0 microversion: 2.1 time: 0.096864 Nov 24 15:22:20.866302 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 215/400] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:22:20 2021] POST /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:22:20.884050 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-29927548-91f3-4e94-acbd-d09e10150faf tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:20.884750 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-29927548-91f3-4e94-acbd-d09e10150faf tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:20.892786 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-29927548-91f3-4e94-acbd-d09e10150faf tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:20.893286 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-29927548-91f3-4e94-acbd-d09e10150faf tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:20.894124 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-29927548-91f3-4e94-acbd-d09e10150faf tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:20.894569 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-29927548-91f3-4e94-acbd-d09e10150faf tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:21.032224 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-1b4a25fa-60a9-412c-a26e-c36dafbe48f0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:21.049529 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-1b4a25fa-60a9-412c-a26e-c36dafbe48f0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1260 microversion: 2.1 time: 0.249412 Nov 24 15:22:21.050759 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 186/401] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:20 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1260 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:21.124575 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-29927548-91f3-4e94-acbd-d09e10150faf tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:21.133190 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-29927548-91f3-4e94-acbd-d09e10150faf tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1556 microversion: 2.1 time: 0.253201 Nov 24 15:22:21.133867 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 216/402] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:20 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1556 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:21.567149 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-18279f6a-f7fd-4788-b3a6-25653dcd8078 req-7af4eeb3-e980-4c8c-90d7-d5254eb1f656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97e7745-6b55-46b5-a651-17bc3a3bdbc9", "name": "network-vif-plugged", "status": "completed", "tag": "00062239-b32a-4c2a-9fb5-f6a38539f917"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:21.569529 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:22:21.569529 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:22:21.593409 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-18279f6a-f7fd-4788-b3a6-25653dcd8078 req-7af4eeb3-e980-4c8c-90d7-d5254eb1f656 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:21.593976 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-18279f6a-f7fd-4788-b3a6-25653dcd8078 req-7af4eeb3-e980-4c8c-90d7-d5254eb1f656 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:21.609386 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-18279f6a-f7fd-4788-b3a6-25653dcd8078 req-7af4eeb3-e980-4c8c-90d7-d5254eb1f656 service nova] Creating event network-vif-plugged:00062239-b32a-4c2a-9fb5-f6a38539f917 for instance b97e7745-6b55-46b5-a651-17bc3a3bdbc9 on hv-cinder-80403 Nov 24 15:22:21.614866 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-18279f6a-f7fd-4788-b3a6-25653dcd8078 req-7af4eeb3-e980-4c8c-90d7-d5254eb1f656 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059614 Nov 24 15:22:21.615744 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 187/403] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:22:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:22:22.067348 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2d96793e-5125-4a24-bd77-000af82738d2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:22.067960 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2d96793e-5125-4a24-bd77-000af82738d2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:22.073972 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2d96793e-5125-4a24-bd77-000af82738d2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:22.075376 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2d96793e-5125-4a24-bd77-000af82738d2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:22.076262 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2d96793e-5125-4a24-bd77-000af82738d2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:22.076610 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2d96793e-5125-4a24-bd77-000af82738d2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:22.151180 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-23f2ae0a-cc49-4d21-8710-53f8f30c40ce tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:22.151908 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-23f2ae0a-cc49-4d21-8710-53f8f30c40ce tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:22.160545 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-23f2ae0a-cc49-4d21-8710-53f8f30c40ce tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:22.161108 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-23f2ae0a-cc49-4d21-8710-53f8f30c40ce tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:22.162081 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-23f2ae0a-cc49-4d21-8710-53f8f30c40ce tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:22.162576 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-23f2ae0a-cc49-4d21-8710-53f8f30c40ce tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:22.224777 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2d96793e-5125-4a24-bd77-000af82738d2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:22.233959 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2d96793e-5125-4a24-bd77-000af82738d2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1260 microversion: 2.1 time: 0.170371 Nov 24 15:22:22.247940 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 217/404] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:22 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:22.335874 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-23f2ae0a-cc49-4d21-8710-53f8f30c40ce tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:22.345671 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-23f2ae0a-cc49-4d21-8710-53f8f30c40ce tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1556 microversion: 2.1 time: 0.198491 Nov 24 15:22:22.346245 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 188/405] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:22 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1556 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:23.266988 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0c832a84-ea55-4a56-88b2-fd12b076648b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:23.267714 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0c832a84-ea55-4a56-88b2-fd12b076648b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:23.274356 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0c832a84-ea55-4a56-88b2-fd12b076648b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:23.274848 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0c832a84-ea55-4a56-88b2-fd12b076648b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:23.275615 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0c832a84-ea55-4a56-88b2-fd12b076648b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:23.276046 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0c832a84-ea55-4a56-88b2-fd12b076648b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:23.363740 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8346ef06-3cce-4e1c-b72b-d7d5ca4ebb62 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:23.364824 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8346ef06-3cce-4e1c-b72b-d7d5ca4ebb62 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:23.372263 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8346ef06-3cce-4e1c-b72b-d7d5ca4ebb62 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:23.374342 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8346ef06-3cce-4e1c-b72b-d7d5ca4ebb62 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:23.375420 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8346ef06-3cce-4e1c-b72b-d7d5ca4ebb62 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:23.376068 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8346ef06-3cce-4e1c-b72b-d7d5ca4ebb62 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:23.694653 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0c832a84-ea55-4a56-88b2-fd12b076648b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:23.703219 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0c832a84-ea55-4a56-88b2-fd12b076648b tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1260 microversion: 2.1 time: 0.449664 Nov 24 15:22:23.703791 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 218/406] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:23 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1260 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:23.724025 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8346ef06-3cce-4e1c-b72b-d7d5ca4ebb62 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:23.732893 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8346ef06-3cce-4e1c-b72b-d7d5ca4ebb62 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1556 microversion: 2.1 time: 0.373261 Nov 24 15:22:23.733724 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 189/407] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:23 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1556 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:24.723052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f96bd908-d89b-44bf-82a1-eec765dd9a4c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:24.723901 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f96bd908-d89b-44bf-82a1-eec765dd9a4c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:24.732272 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f96bd908-d89b-44bf-82a1-eec765dd9a4c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:24.733094 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f96bd908-d89b-44bf-82a1-eec765dd9a4c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:24.734035 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f96bd908-d89b-44bf-82a1-eec765dd9a4c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:24.734691 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f96bd908-d89b-44bf-82a1-eec765dd9a4c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:24.750949 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-7f0d8908-cd58-4dd1-b80c-8bf3cec5e030 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:24.752262 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-7f0d8908-cd58-4dd1-b80c-8bf3cec5e030 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:24.758920 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7f0d8908-cd58-4dd1-b80c-8bf3cec5e030 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:24.759995 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7f0d8908-cd58-4dd1-b80c-8bf3cec5e030 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:24.761026 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7f0d8908-cd58-4dd1-b80c-8bf3cec5e030 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:24.761657 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7f0d8908-cd58-4dd1-b80c-8bf3cec5e030 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:24.938093 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f96bd908-d89b-44bf-82a1-eec765dd9a4c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:24.946150 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f96bd908-d89b-44bf-82a1-eec765dd9a4c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1443 microversion: 2.1 time: 0.228045 Nov 24 15:22:24.949832 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 219/408] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:24 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1443 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:24.965028 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-7f0d8908-cd58-4dd1-b80c-8bf3cec5e030 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:24.966759 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0fd58d0a-0eb3-4fdc-97b4-629abd294a42 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:24.967555 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0fd58d0a-0eb3-4fdc-97b4-629abd294a42 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:24.973527 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-7f0d8908-cd58-4dd1-b80c-8bf3cec5e030 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1562 microversion: 2.1 time: 0.226351 Nov 24 15:22:24.974082 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0fd58d0a-0eb3-4fdc-97b4-629abd294a42 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:24.974534 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 190/409] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:24 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:24.986052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0fd58d0a-0eb3-4fdc-97b4-629abd294a42 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:24.986052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0fd58d0a-0eb3-4fdc-97b4-629abd294a42 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:24.986052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0fd58d0a-0eb3-4fdc-97b4-629abd294a42 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:25.043548 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-581cb533-3f4a-4971-accb-3b1a13e53073 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:25.043548 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-581cb533-3f4a-4971-accb-3b1a13e53073 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:25.055521 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-581cb533-3f4a-4971-accb-3b1a13e53073 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:25.055914 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-581cb533-3f4a-4971-accb-3b1a13e53073 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:25.056895 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-581cb533-3f4a-4971-accb-3b1a13e53073 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:25.057306 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-581cb533-3f4a-4971-accb-3b1a13e53073 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:25.167796 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0fd58d0a-0eb3-4fdc-97b4-629abd294a42 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:25.176091 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0fd58d0a-0eb3-4fdc-97b4-629abd294a42 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1443 microversion: 2.1 time: 0.213262 Nov 24 15:22:25.176956 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 220/410] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:24 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1443 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:25.184062 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-581cb533-3f4a-4971-accb-3b1a13e53073 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lazy-loading 'services' on Instance uuid 54c23d97-138c-40a2-9593-8896dfdb2650 {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:22:25.329378 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-581cb533-3f4a-4971-accb-3b1a13e53073 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "DELETE /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/os-volume_attachments/08ae13e4-59e5-4b43-8803-e86ce60fbd7a" status: 202 len: 0 microversion: 2.1 time: 0.289846 Nov 24 15:22:25.330229 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 191/411] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Nov 24 15:22:25 2021] DELETE /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/os-volume_attachments/08ae13e4-59e5-4b43-8803-e86ce60fbd7a => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:22:25.338315 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-99341fd8-030a-44ff-850f-0c696d69af34 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:25.339347 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-99341fd8-030a-44ff-850f-0c696d69af34 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:25.348593 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99341fd8-030a-44ff-850f-0c696d69af34 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:25.349011 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99341fd8-030a-44ff-850f-0c696d69af34 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:25.349831 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99341fd8-030a-44ff-850f-0c696d69af34 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:25.350350 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99341fd8-030a-44ff-850f-0c696d69af34 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:25.391138 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-99341fd8-030a-44ff-850f-0c696d69af34 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056490 Nov 24 15:22:25.395509 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 221/412] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:22:25 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:22:26.403570 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-10b91e74-dc9b-49a5-a470-5c338b5bffd3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:26.405304 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-10b91e74-dc9b-49a5-a470-5c338b5bffd3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:26.417143 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-10b91e74-dc9b-49a5-a470-5c338b5bffd3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:26.422139 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-10b91e74-dc9b-49a5-a470-5c338b5bffd3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:26.423778 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-10b91e74-dc9b-49a5-a470-5c338b5bffd3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:26.424233 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-10b91e74-dc9b-49a5-a470-5c338b5bffd3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:26.615581 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-10b91e74-dc9b-49a5-a470-5c338b5bffd3 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.216670 Nov 24 15:22:26.616436 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 192/413] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:22:26 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650/os-volume_attachments => generated 25 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:22:27.654792 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-cd2d00f3-c033-403b-9b29-c1b150d6baf0 req-bba15a0c-b308-4cc6-a3af-d205aa14aba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97e7745-6b55-46b5-a651-17bc3a3bdbc9", "tag": "00062239-b32a-4c2a-9fb5-f6a38539f917"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:27.657151 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:22:27.657151 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:22:27.664496 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-cd2d00f3-c033-403b-9b29-c1b150d6baf0 req-bba15a0c-b308-4cc6-a3af-d205aa14aba2 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:27.664942 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-cd2d00f3-c033-403b-9b29-c1b150d6baf0 req-bba15a0c-b308-4cc6-a3af-d205aa14aba2 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:27.677094 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-cd2d00f3-c033-403b-9b29-c1b150d6baf0 req-bba15a0c-b308-4cc6-a3af-d205aa14aba2 service nova] Creating event network-changed:00062239-b32a-4c2a-9fb5-f6a38539f917 for instance b97e7745-6b55-46b5-a651-17bc3a3bdbc9 on hv-cinder-80403 Nov 24 15:22:27.682637 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-cd2d00f3-c033-403b-9b29-c1b150d6baf0 req-bba15a0c-b308-4cc6-a3af-d205aa14aba2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031347 Nov 24 15:22:27.683988 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 222/414] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:22:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:22:28.979194 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8f570206-d933-4094-8625-12c7b7a9a0d7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:28.979737 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8f570206-d933-4094-8625-12c7b7a9a0d7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:28.986111 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f570206-d933-4094-8625-12c7b7a9a0d7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:28.986555 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f570206-d933-4094-8625-12c7b7a9a0d7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:28.987564 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f570206-d933-4094-8625-12c7b7a9a0d7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:28.988104 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f570206-d933-4094-8625-12c7b7a9a0d7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:29.024217 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8f570206-d933-4094-8625-12c7b7a9a0d7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Going to try to terminate instance {{(pid=116073) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:22:29.106906 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8f570206-d933-4094-8625-12c7b7a9a0d7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 204 len: 0 microversion: 2.1 time: 0.130830 Nov 24 15:22:29.108158 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 193/415] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:22:28 2021] DELETE /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:22:29.119192 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-620abc62-9a6d-4e85-9bcb-ecbd4980a6da tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:29.119889 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-620abc62-9a6d-4e85-9bcb-ecbd4980a6da tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:29.126564 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-620abc62-9a6d-4e85-9bcb-ecbd4980a6da tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:29.127161 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-620abc62-9a6d-4e85-9bcb-ecbd4980a6da tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:29.127948 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-620abc62-9a6d-4e85-9bcb-ecbd4980a6da tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:29.128384 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-620abc62-9a6d-4e85-9bcb-ecbd4980a6da tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:29.318405 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-620abc62-9a6d-4e85-9bcb-ecbd4980a6da tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:29.327107 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-620abc62-9a6d-4e85-9bcb-ecbd4980a6da tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1507 microversion: 2.1 time: 0.213710 Nov 24 15:22:29.328973 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 223/416] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:29 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:30.347337 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ef2b6326-be7e-4676-bdf7-55ee2a998b1d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:30.348650 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ef2b6326-be7e-4676-bdf7-55ee2a998b1d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:30.355041 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ef2b6326-be7e-4676-bdf7-55ee2a998b1d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:30.355506 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ef2b6326-be7e-4676-bdf7-55ee2a998b1d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:30.356368 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ef2b6326-be7e-4676-bdf7-55ee2a998b1d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:30.356845 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ef2b6326-be7e-4676-bdf7-55ee2a998b1d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:30.506749 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ef2b6326-be7e-4676-bdf7-55ee2a998b1d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:30.515995 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ef2b6326-be7e-4676-bdf7-55ee2a998b1d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1507 microversion: 2.1 time: 0.172510 Nov 24 15:22:30.516822 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 194/417] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:30 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1507 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:31.533585 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-55d4fdff-54bc-4da7-bee1-acf68d70d2c9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:31.534157 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-55d4fdff-54bc-4da7-bee1-acf68d70d2c9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:31.540463 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55d4fdff-54bc-4da7-bee1-acf68d70d2c9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:31.540913 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55d4fdff-54bc-4da7-bee1-acf68d70d2c9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:31.541694 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55d4fdff-54bc-4da7-bee1-acf68d70d2c9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:31.542126 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55d4fdff-54bc-4da7-bee1-acf68d70d2c9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:31.683526 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-55d4fdff-54bc-4da7-bee1-acf68d70d2c9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:31.691433 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-55d4fdff-54bc-4da7-bee1-acf68d70d2c9 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1507 microversion: 2.1 time: 0.161549 Nov 24 15:22:31.692064 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 224/418] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:31 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:32.711116 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-fe5b306c-d0bc-4fca-b3da-4bb98b496c84 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:32.712776 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-fe5b306c-d0bc-4fca-b3da-4bb98b496c84 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:32.722600 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fe5b306c-d0bc-4fca-b3da-4bb98b496c84 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:32.723081 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fe5b306c-d0bc-4fca-b3da-4bb98b496c84 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:32.725453 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fe5b306c-d0bc-4fca-b3da-4bb98b496c84 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:32.726000 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fe5b306c-d0bc-4fca-b3da-4bb98b496c84 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:32.891018 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-fe5b306c-d0bc-4fca-b3da-4bb98b496c84 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:32.901524 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-fe5b306c-d0bc-4fca-b3da-4bb98b496c84 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 200 len: 1507 microversion: 2.1 time: 0.195093 Nov 24 15:22:32.912318 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 195/419] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:32 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 1507 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:33.107911 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-7d31e869-900d-44e8-b0ca-ac2f49c76c50 req-b827f887-f2c6-4faf-901d-88a40e4d3693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1b8192-257b-42e9-8aad-a40ce8bfb4f8", "name": "network-vif-deleted", "tag": "ba4bd5dc-d328-477a-9c65-f3aeb75a0f70"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:33.111005 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:22:33.111005 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:22:33.119673 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7d31e869-900d-44e8-b0ca-ac2f49c76c50 req-b827f887-f2c6-4faf-901d-88a40e4d3693 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:33.120651 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7d31e869-900d-44e8-b0ca-ac2f49c76c50 req-b827f887-f2c6-4faf-901d-88a40e4d3693 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:33.135940 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-7d31e869-900d-44e8-b0ca-ac2f49c76c50 req-b827f887-f2c6-4faf-901d-88a40e4d3693 service nova] Creating event network-vif-deleted:ba4bd5dc-d328-477a-9c65-f3aeb75a0f70 for instance 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 on hv-cinder-80403 Nov 24 15:22:33.144503 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-7d31e869-900d-44e8-b0ca-ac2f49c76c50 req-b827f887-f2c6-4faf-901d-88a40e4d3693 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041896 Nov 24 15:22:33.145841 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 225/420] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:22:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:22:33.922760 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ca44f98f-4de9-4906-bbfb-3fed470e690d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:33.924054 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ca44f98f-4de9-4906-bbfb-3fed470e690d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:33.931567 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca44f98f-4de9-4906-bbfb-3fed470e690d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:33.932334 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca44f98f-4de9-4906-bbfb-3fed470e690d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:33.933440 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca44f98f-4de9-4906-bbfb-3fed470e690d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:33.934191 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca44f98f-4de9-4906-bbfb-3fed470e690d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:33.950497 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-ca44f98f-4de9-4906-bbfb-3fed470e690d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] HTTP exception thrown: Instance 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 could not be found. Nov 24 15:22:33.951348 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ca44f98f-4de9-4906-bbfb-3fed470e690d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Returning 404 to user: Instance 1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:22:33.952199 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ca44f98f-4de9-4906-bbfb-3fed470e690d tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8" status: 404 len: 111 microversion: 2.1 time: 0.035290 Nov 24 15:22:33.956163 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 196/421] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:33 2021] GET /compute/v2.1/servers/1b1b8192-257b-42e9-8aad-a40ce8bfb4f8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:22:33.962156 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c8597965-29b5-4a99-b393-7b931d55f2e7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:33.962779 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c8597965-29b5-4a99-b393-7b931d55f2e7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:33.970890 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8597965-29b5-4a99-b393-7b931d55f2e7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:33.971335 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8597965-29b5-4a99-b393-7b931d55f2e7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:33.972291 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8597965-29b5-4a99-b393-7b931d55f2e7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:33.972724 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8597965-29b5-4a99-b393-7b931d55f2e7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:33.999139 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c8597965-29b5-4a99-b393-7b931d55f2e7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:22:34.095477 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c8597965-29b5-4a99-b393-7b931d55f2e7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "DELETE /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 204 len: 0 microversion: 2.1 time: 0.137436 Nov 24 15:22:34.096423 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 226/422] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:22:33 2021] DELETE /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:22:34.105051 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-5f356d92-03a4-4d8a-a64c-0998a017b8bb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:34.106451 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-5f356d92-03a4-4d8a-a64c-0998a017b8bb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:34.112894 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5f356d92-03a4-4d8a-a64c-0998a017b8bb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:34.113396 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5f356d92-03a4-4d8a-a64c-0998a017b8bb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:34.114723 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5f356d92-03a4-4d8a-a64c-0998a017b8bb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:34.115193 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5f356d92-03a4-4d8a-a64c-0998a017b8bb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:34.267512 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-5f356d92-03a4-4d8a-a64c-0998a017b8bb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:34.274892 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-5f356d92-03a4-4d8a-a64c-0998a017b8bb tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.174284 Nov 24 15:22:34.275451 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 197/423] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:34 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:35.293220 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e3985dbf-a515-4ae7-8475-ef0d25631f03 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:35.294420 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e3985dbf-a515-4ae7-8475-ef0d25631f03 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:35.300898 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e3985dbf-a515-4ae7-8475-ef0d25631f03 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:35.301429 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e3985dbf-a515-4ae7-8475-ef0d25631f03 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:35.302231 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e3985dbf-a515-4ae7-8475-ef0d25631f03 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:35.302667 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e3985dbf-a515-4ae7-8475-ef0d25631f03 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:35.463362 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e3985dbf-a515-4ae7-8475-ef0d25631f03 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:35.472951 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e3985dbf-a515-4ae7-8475-ef0d25631f03 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.183901 Nov 24 15:22:35.476503 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 227/424] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:35 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:36.491391 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-cb761119-508f-4499-97f1-f2fd586e5ee4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:36.492104 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-cb761119-508f-4499-97f1-f2fd586e5ee4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:36.499552 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cb761119-508f-4499-97f1-f2fd586e5ee4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:36.500288 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cb761119-508f-4499-97f1-f2fd586e5ee4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:36.501072 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cb761119-508f-4499-97f1-f2fd586e5ee4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:36.501679 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cb761119-508f-4499-97f1-f2fd586e5ee4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:36.654911 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-cb761119-508f-4499-97f1-f2fd586e5ee4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:36.663252 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-cb761119-508f-4499-97f1-f2fd586e5ee4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.175709 Nov 24 15:22:36.664157 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 198/425] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:36 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:37.682918 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e62a3398-1153-42a6-8272-4807aac51ce7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:37.683525 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e62a3398-1153-42a6-8272-4807aac51ce7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:37.689779 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e62a3398-1153-42a6-8272-4807aac51ce7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:37.690227 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e62a3398-1153-42a6-8272-4807aac51ce7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:37.691033 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e62a3398-1153-42a6-8272-4807aac51ce7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:37.691474 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e62a3398-1153-42a6-8272-4807aac51ce7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:37.834463 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e62a3398-1153-42a6-8272-4807aac51ce7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:37.841743 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e62a3398-1153-42a6-8272-4807aac51ce7 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.162591 Nov 24 15:22:37.842306 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 228/426] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:37 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:38.858892 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-e123aec7-37d5-427a-aabd-c4e236d46c4a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:38.859499 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-e123aec7-37d5-427a-aabd-c4e236d46c4a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:38.866545 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e123aec7-37d5-427a-aabd-c4e236d46c4a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:38.867107 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e123aec7-37d5-427a-aabd-c4e236d46c4a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:38.867959 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e123aec7-37d5-427a-aabd-c4e236d46c4a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:38.868469 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e123aec7-37d5-427a-aabd-c4e236d46c4a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:39.008961 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e123aec7-37d5-427a-aabd-c4e236d46c4a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:39.017110 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-e123aec7-37d5-427a-aabd-c4e236d46c4a tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.162218 Nov 24 15:22:39.017641 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 199/427] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:38 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:40.034624 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c461dc01-c750-4abb-8c30-28c794e731e4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:40.036100 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c461dc01-c750-4abb-8c30-28c794e731e4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:40.043097 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c461dc01-c750-4abb-8c30-28c794e731e4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:40.043855 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c461dc01-c750-4abb-8c30-28c794e731e4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:40.044916 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c461dc01-c750-4abb-8c30-28c794e731e4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:40.045413 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c461dc01-c750-4abb-8c30-28c794e731e4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:40.186409 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c461dc01-c750-4abb-8c30-28c794e731e4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:40.194515 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c461dc01-c750-4abb-8c30-28c794e731e4 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.163567 Nov 24 15:22:40.205909 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 229/428] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:40 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:41.213388 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2527c428-c7d4-420e-bdf8-1a50317dad9f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:41.213976 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2527c428-c7d4-420e-bdf8-1a50317dad9f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:41.220654 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2527c428-c7d4-420e-bdf8-1a50317dad9f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:41.221142 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2527c428-c7d4-420e-bdf8-1a50317dad9f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:41.221924 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2527c428-c7d4-420e-bdf8-1a50317dad9f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:41.222359 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2527c428-c7d4-420e-bdf8-1a50317dad9f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:41.362744 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-2527c428-c7d4-420e-bdf8-1a50317dad9f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:41.370770 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2527c428-c7d4-420e-bdf8-1a50317dad9f tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1522 microversion: 2.1 time: 0.160968 Nov 24 15:22:41.371360 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 200/429] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:41 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:41.990282 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ea1c8432-acb5-4167-b75d-f6e46652af7c tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82a26241-f678-40a9-8fd1-37228e47d28b", "device": "/dev/sdb"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:41.992154 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ea1c8432-acb5-4167-b75d-f6e46652af7c tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:41.999601 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ea1c8432-acb5-4167-b75d-f6e46652af7c tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:42.000279 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ea1c8432-acb5-4167-b75d-f6e46652af7c tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:42.001393 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ea1c8432-acb5-4167-b75d-f6e46652af7c tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:42.002079 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ea1c8432-acb5-4167-b75d-f6e46652af7c tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:42.333508 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-71957b58-c4e4-4b59-85b5-bd4963d50030 req-207cd7f0-0af1-43a5-9e50-f1023c9a834a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c23d97-138c-40a2-9593-8896dfdb2650", "name": "network-vif-deleted", "tag": "78dc38d0-e790-4e67-9cc9-06ac9d53b726"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:42.335952 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:22:42.335952 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:22:42.349659 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-71957b58-c4e4-4b59-85b5-bd4963d50030 req-207cd7f0-0af1-43a5-9e50-f1023c9a834a service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:42.350427 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-71957b58-c4e4-4b59-85b5-bd4963d50030 req-207cd7f0-0af1-43a5-9e50-f1023c9a834a service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:42.367080 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ea1c8432-acb5-4167-b75d-f6e46652af7c tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "POST /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380557 Nov 24 15:22:42.374072 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 230/430] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Nov 24 15:22:41 2021] POST /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2/os-volume_attachments => generated 194 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:22:42.376755 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-71957b58-c4e4-4b59-85b5-bd4963d50030 req-207cd7f0-0af1-43a5-9e50-f1023c9a834a service nova] Creating event network-vif-deleted:78dc38d0-e790-4e67-9cc9-06ac9d53b726 for instance 54c23d97-138c-40a2-9593-8896dfdb2650 on hv-cinder-80403 Nov 24 15:22:42.390310 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b5cbf85b-e04a-44dc-982c-fa978be4e960 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:42.391065 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b5cbf85b-e04a-44dc-982c-fa978be4e960 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:42.399102 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-71957b58-c4e4-4b59-85b5-bd4963d50030 req-207cd7f0-0af1-43a5-9e50-f1023c9a834a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066448 Nov 24 15:22:42.400718 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5cbf85b-e04a-44dc-982c-fa978be4e960 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:42.407999 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 201/431] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:22:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:22:42.409770 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5cbf85b-e04a-44dc-982c-fa978be4e960 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:42.412853 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5cbf85b-e04a-44dc-982c-fa978be4e960 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:42.414051 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b5cbf85b-e04a-44dc-982c-fa978be4e960 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:42.508807 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b5cbf85b-e04a-44dc-982c-fa978be4e960 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ede07ca84abc4ee6947d36c55591c84d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32404aa4e2d44b9e966da2bab0b27149', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:42.517035 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b5cbf85b-e04a-44dc-982c-fa978be4e960 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 200 len: 1307 microversion: 2.1 time: 0.132730 Nov 24 15:22:42.517728 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 231/432] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:42 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 1307 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:22:43.533942 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3e356e9e-578c-4838-b327-b86780e61501 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:43.534654 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3e356e9e-578c-4838-b327-b86780e61501 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] [instance: 54c23d97-138c-40a2-9593-8896dfdb2650] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:43.541650 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3e356e9e-578c-4838-b327-b86780e61501 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:43.542180 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3e356e9e-578c-4838-b327-b86780e61501 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:43.542993 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3e356e9e-578c-4838-b327-b86780e61501 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:43.543963 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3e356e9e-578c-4838-b327-b86780e61501 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:43.557534 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-3e356e9e-578c-4838-b327-b86780e61501 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] HTTP exception thrown: Instance 54c23d97-138c-40a2-9593-8896dfdb2650 could not be found. Nov 24 15:22:43.558188 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3e356e9e-578c-4838-b327-b86780e61501 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] Returning 404 to user: Instance 54c23d97-138c-40a2-9593-8896dfdb2650 could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:22:43.559920 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3e356e9e-578c-4838-b327-b86780e61501 tempest-ServerRescueNegativeTestJSON-681681792 tempest-ServerRescueNegativeTestJSON-681681792-project] 10.222.0.66 "GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650" status: 404 len: 111 microversion: 2.1 time: 0.029562 Nov 24 15:22:43.564013 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 202/433] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:43 2021] GET /compute/v2.1/servers/54c23d97-138c-40a2-9593-8896dfdb2650 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:22:52.356214 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4dcc7d27-19a7-4683-9b62-4b0252e7a520 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'create', calling method: .version_select at 0x7f930cde1e50>, body: {"keypair": {"name": "tempest-keypair-1554345585"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:52.371315 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-4dcc7d27-19a7-4683-9b62-4b0252e7a520 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Getting quotas for project 15cfbeac1f3f4700a4806775a9786f5d. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:22:52.376588 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-4dcc7d27-19a7-4683-9b62-4b0252e7a520 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Getting quotas for user b9a6a76c456447a0b1d07b757efaf601 and project 15cfbeac1f3f4700a4806775a9786f5d. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:22:52.732779 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-4dcc7d27-19a7-4683-9b62-4b0252e7a520 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Getting quotas for project 15cfbeac1f3f4700a4806775a9786f5d. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:22:52.740570 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-4dcc7d27-19a7-4683-9b62-4b0252e7a520 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Getting quotas for user b9a6a76c456447a0b1d07b757efaf601 and project 15cfbeac1f3f4700a4806775a9786f5d. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:22:52.766081 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4dcc7d27-19a7-4683-9b62-4b0252e7a520 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.576362 Nov 24 15:22:52.767351 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 232/434] 10.222.0.66 () {62 vars in 1198 bytes} [Wed Nov 24 15:22:52 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 580 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 24 15:22:54.222602 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-312abe9e-6d69-4ef0-a0a9-0e50420eb51c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:54.223280 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-312abe9e-6d69-4ef0-a0a9-0e50420eb51c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:54.231806 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-312abe9e-6d69-4ef0-a0a9-0e50420eb51c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:54.232562 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-312abe9e-6d69-4ef0-a0a9-0e50420eb51c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:54.233690 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-312abe9e-6d69-4ef0-a0a9-0e50420eb51c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:54.234400 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-312abe9e-6d69-4ef0-a0a9-0e50420eb51c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:54.358301 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-946129830", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e130b39d-08a3-4f56-a8c9-cdbf0ac59277"}], "security_groups": [{"name": "tempest-securitygroup--555177954"}], "key_name": "tempest-keypair-1554345585", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:54.385762 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-312abe9e-6d69-4ef0-a0a9-0e50420eb51c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lazy-loading 'services' on Instance uuid 60818665-e1d1-4651-9b32-94b226a506c9 {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:22:54.497042 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] validate_networks() for [('e130b39d-08a3-4f56-a8c9-cdbf0ac59277', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:22:54.505112 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-312abe9e-6d69-4ef0-a0a9-0e50420eb51c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "DELETE /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/os-volume_attachments/fcc1403d-fdc7-473f-99a7-7813d694f06d" status: 202 len: 0 microversion: 2.1 time: 0.285697 Nov 24 15:22:54.505721 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 203/435] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Nov 24 15:22:54 2021] DELETE /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/os-volume_attachments/fcc1403d-fdc7-473f-99a7-7813d694f06d => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:22:54.921053 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:22:54.921885 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:22:54.922829 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:22:54.923500 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:22:54.924111 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:22:54.933118 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:54.933657 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:54.934518 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:54.934999 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:54.951572 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Getting quotas for project 15cfbeac1f3f4700a4806775a9786f5d. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:22:54.955619 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Getting quotas for user b9a6a76c456447a0b1d07b757efaf601 and project 15cfbeac1f3f4700a4806775a9786f5d. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:22:54.967210 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:22:54.969544 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:22:55.020431 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3d02aecf-2b8c-4f65-baa5-0d84f54e5b5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.666595 Nov 24 15:22:55.021763 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 233/436] 10.222.0.66 () {62 vars in 1187 bytes} [Wed Nov 24 15:22:54 2021] POST /compute/v2.1/servers => generated 401 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 24 15:22:55.032754 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-59a57623-721c-43b9-a03d-eb079ff95099 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:55.033583 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-59a57623-721c-43b9-a03d-eb079ff95099 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:55.106971 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-59a57623-721c-43b9-a03d-eb079ff95099 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:55.117996 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-59a57623-721c-43b9-a03d-eb079ff95099 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:55.119760 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-59a57623-721c-43b9-a03d-eb079ff95099 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:55.122317 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-59a57623-721c-43b9-a03d-eb079ff95099 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1281 microversion: 2.20 time: 0.093143 Nov 24 15:22:55.124439 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 204/437] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:22:55 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1281 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:22:56.141157 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-dd14af99-11d1-4853-9a00-2c034cbf8359 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:56.141788 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-dd14af99-11d1-4853-9a00-2c034cbf8359 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:56.149102 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dd14af99-11d1-4853-9a00-2c034cbf8359 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:56.149551 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dd14af99-11d1-4853-9a00-2c034cbf8359 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:56.150327 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dd14af99-11d1-4853-9a00-2c034cbf8359 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:56.150756 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dd14af99-11d1-4853-9a00-2c034cbf8359 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:56.218954 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-dd14af99-11d1-4853-9a00-2c034cbf8359 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:56.227770 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-dd14af99-11d1-4853-9a00-2c034cbf8359 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:56.229258 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-dd14af99-11d1-4853-9a00-2c034cbf8359 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:56.230356 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-dd14af99-11d1-4853-9a00-2c034cbf8359 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1285 microversion: 2.20 time: 0.092991 Nov 24 15:22:56.231914 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 234/438] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:22:56 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:22:57.249696 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-77a2ecfa-ad1a-4b01-be40-84bcb85f79f7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:57.250295 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-77a2ecfa-ad1a-4b01-be40-84bcb85f79f7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:57.257361 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-77a2ecfa-ad1a-4b01-be40-84bcb85f79f7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:57.257804 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-77a2ecfa-ad1a-4b01-be40-84bcb85f79f7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:57.258613 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-77a2ecfa-ad1a-4b01-be40-84bcb85f79f7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:57.259069 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-77a2ecfa-ad1a-4b01-be40-84bcb85f79f7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:57.317132 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-77a2ecfa-ad1a-4b01-be40-84bcb85f79f7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:57.325618 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-77a2ecfa-ad1a-4b01-be40-84bcb85f79f7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:57.327118 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-77a2ecfa-ad1a-4b01-be40-84bcb85f79f7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:57.328199 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-77a2ecfa-ad1a-4b01-be40-84bcb85f79f7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1285 microversion: 2.20 time: 0.082766 Nov 24 15:22:57.328757 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 205/439] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:22:57 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:22:58.346547 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2430e6de-5298-4ff2-9824-079f030ba589 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:58.348103 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2430e6de-5298-4ff2-9824-079f030ba589 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:58.354157 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2430e6de-5298-4ff2-9824-079f030ba589 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:58.354714 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2430e6de-5298-4ff2-9824-079f030ba589 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:58.355617 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2430e6de-5298-4ff2-9824-079f030ba589 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:58.356144 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2430e6de-5298-4ff2-9824-079f030ba589 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:58.420947 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2430e6de-5298-4ff2-9824-079f030ba589 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:58.428778 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2430e6de-5298-4ff2-9824-079f030ba589 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:58.430259 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2430e6de-5298-4ff2-9824-079f030ba589 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:58.431401 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2430e6de-5298-4ff2-9824-079f030ba589 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1351 microversion: 2.20 time: 0.088554 Nov 24 15:22:58.438203 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 235/440] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:22:58 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:22:58.800412 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-9185b1c6-3a30-4a4d-be54-5d1af5e39d60 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:58.807657 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9185b1c6-3a30-4a4d-be54-5d1af5e39d60 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:58.808107 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9185b1c6-3a30-4a4d-be54-5d1af5e39d60 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:58.833937 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-9185b1c6-3a30-4a4d-be54-5d1af5e39d60 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Going to try to stop instance {{(pid=116073) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 24 15:22:58.878883 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-9185b1c6-3a30-4a4d-be54-5d1af5e39d60 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 202 len: 0 microversion: 2.1 time: 0.081896 Nov 24 15:22:58.879715 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 206/441] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:22:58 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:22:58.887921 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f5876666-0810-454d-8356-cdb088f5ca5e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:58.888818 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f5876666-0810-454d-8356-cdb088f5ca5e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:58.895513 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f5876666-0810-454d-8356-cdb088f5ca5e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:58.895978 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f5876666-0810-454d-8356-cdb088f5ca5e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:58.896819 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f5876666-0810-454d-8356-cdb088f5ca5e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:58.897481 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f5876666-0810-454d-8356-cdb088f5ca5e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:59.041629 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f5876666-0810-454d-8356-cdb088f5ca5e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:59.052162 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f5876666-0810-454d-8356-cdb088f5ca5e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1675 microversion: 2.1 time: 0.168415 Nov 24 15:22:59.052918 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 236/442] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:22:58 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:22:59.450533 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-07f10d1e-f07b-48a1-9c7b-c70f79ed1b1e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:22:59.451567 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-07f10d1e-f07b-48a1-9c7b-c70f79ed1b1e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:22:59.457902 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-07f10d1e-f07b-48a1-9c7b-c70f79ed1b1e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:59.458480 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-07f10d1e-f07b-48a1-9c7b-c70f79ed1b1e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:59.459396 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-07f10d1e-f07b-48a1-9c7b-c70f79ed1b1e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:59.459927 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-07f10d1e-f07b-48a1-9c7b-c70f79ed1b1e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:59.608391 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-07f10d1e-f07b-48a1-9c7b-c70f79ed1b1e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:59.617023 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-07f10d1e-f07b-48a1-9c7b-c70f79ed1b1e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:59.618675 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-07f10d1e-f07b-48a1-9c7b-c70f79ed1b1e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:22:59.620106 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-07f10d1e-f07b-48a1-9c7b-c70f79ed1b1e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1406 microversion: 2.20 time: 0.173645 Nov 24 15:22:59.621408 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 207/443] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:22:59 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:22:59.673214 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-fc313596-b189-498d-a942-27721b80fb5c req-5536c5b8-201c-4b9e-adc2-07502a04dab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361e1e6c-853b-4fde-89ed-843a85be79c1", "tag": "66d6070e-c6fb-4ac7-8705-204f502bc368"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:22:59.677545 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:22:59.677545 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:22:59.690607 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-fc313596-b189-498d-a942-27721b80fb5c req-5536c5b8-201c-4b9e-adc2-07502a04dab3 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:22:59.691090 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-fc313596-b189-498d-a942-27721b80fb5c req-5536c5b8-201c-4b9e-adc2-07502a04dab3 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:22:59.702323 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-fc313596-b189-498d-a942-27721b80fb5c req-5536c5b8-201c-4b9e-adc2-07502a04dab3 service nova] Creating event network-changed:66d6070e-c6fb-4ac7-8705-204f502bc368 for instance 361e1e6c-853b-4fde-89ed-843a85be79c1 on hv-cinder-80403 Nov 24 15:22:59.707269 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-fc313596-b189-498d-a942-27721b80fb5c req-5536c5b8-201c-4b9e-adc2-07502a04dab3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041656 Nov 24 15:22:59.707865 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 237/444] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:22:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:23:00.070063 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8775c625-98fc-459e-b199-8d65dd106a6d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:00.071483 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8775c625-98fc-459e-b199-8d65dd106a6d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:00.078424 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8775c625-98fc-459e-b199-8d65dd106a6d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:00.078931 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8775c625-98fc-459e-b199-8d65dd106a6d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:00.079712 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8775c625-98fc-459e-b199-8d65dd106a6d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:00.080142 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8775c625-98fc-459e-b199-8d65dd106a6d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:00.213763 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8775c625-98fc-459e-b199-8d65dd106a6d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:00.221014 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8775c625-98fc-459e-b199-8d65dd106a6d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1675 microversion: 2.1 time: 0.154933 Nov 24 15:23:00.221566 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 208/445] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:00 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:00.638599 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cb383f2d-767c-4bde-b6fa-de48728bb7dc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:00.639320 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cb383f2d-767c-4bde-b6fa-de48728bb7dc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:00.645395 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb383f2d-767c-4bde-b6fa-de48728bb7dc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:00.645843 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb383f2d-767c-4bde-b6fa-de48728bb7dc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:00.646621 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb383f2d-767c-4bde-b6fa-de48728bb7dc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:00.647150 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb383f2d-767c-4bde-b6fa-de48728bb7dc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:00.773091 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cb383f2d-767c-4bde-b6fa-de48728bb7dc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:00.780844 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cb383f2d-767c-4bde-b6fa-de48728bb7dc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:00.782347 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cb383f2d-767c-4bde-b6fa-de48728bb7dc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:00.783488 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cb383f2d-767c-4bde-b6fa-de48728bb7dc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1406 microversion: 2.20 time: 0.148978 Nov 24 15:23:00.784043 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 238/446] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:23:00 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:23:01.239238 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-58db66af-088a-4771-b903-cdcad3f51a7b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:01.239847 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-58db66af-088a-4771-b903-cdcad3f51a7b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:01.246225 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-58db66af-088a-4771-b903-cdcad3f51a7b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:01.246674 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-58db66af-088a-4771-b903-cdcad3f51a7b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:01.247486 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-58db66af-088a-4771-b903-cdcad3f51a7b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:01.247915 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-58db66af-088a-4771-b903-cdcad3f51a7b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:01.377718 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-58db66af-088a-4771-b903-cdcad3f51a7b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:01.384899 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-58db66af-088a-4771-b903-cdcad3f51a7b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1675 microversion: 2.1 time: 0.149685 Nov 24 15:23:01.385451 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 209/447] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:01 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:01.800787 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d818b2ce-9e93-42e3-8679-cc3fcb291623 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:01.801399 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d818b2ce-9e93-42e3-8679-cc3fcb291623 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:01.807657 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d818b2ce-9e93-42e3-8679-cc3fcb291623 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:01.808120 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d818b2ce-9e93-42e3-8679-cc3fcb291623 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:01.808898 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d818b2ce-9e93-42e3-8679-cc3fcb291623 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:01.809331 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d818b2ce-9e93-42e3-8679-cc3fcb291623 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:01.945845 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d818b2ce-9e93-42e3-8679-cc3fcb291623 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:01.955894 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d818b2ce-9e93-42e3-8679-cc3fcb291623 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:01.957371 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d818b2ce-9e93-42e3-8679-cc3fcb291623 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:01.958465 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d818b2ce-9e93-42e3-8679-cc3fcb291623 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1406 microversion: 2.20 time: 0.161420 Nov 24 15:23:01.959080 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 239/448] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:23:01 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:23:02.401734 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ec0f80d2-f0a4-4dd0-8feb-5b670010ebf1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:02.402340 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ec0f80d2-f0a4-4dd0-8feb-5b670010ebf1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:02.409152 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ec0f80d2-f0a4-4dd0-8feb-5b670010ebf1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:02.409603 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ec0f80d2-f0a4-4dd0-8feb-5b670010ebf1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:02.410384 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ec0f80d2-f0a4-4dd0-8feb-5b670010ebf1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:02.410836 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ec0f80d2-f0a4-4dd0-8feb-5b670010ebf1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:02.541386 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ec0f80d2-f0a4-4dd0-8feb-5b670010ebf1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:02.548921 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ec0f80d2-f0a4-4dd0-8feb-5b670010ebf1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1675 microversion: 2.1 time: 0.150799 Nov 24 15:23:02.549481 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 210/449] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:02 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:02.976982 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-eae9923f-befb-42a2-8f9b-17fd43fc0f7d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:02.977686 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-eae9923f-befb-42a2-8f9b-17fd43fc0f7d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:02.983601 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eae9923f-befb-42a2-8f9b-17fd43fc0f7d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:02.984057 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eae9923f-befb-42a2-8f9b-17fd43fc0f7d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:02.984825 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eae9923f-befb-42a2-8f9b-17fd43fc0f7d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:02.985252 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eae9923f-befb-42a2-8f9b-17fd43fc0f7d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:03.121911 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-eae9923f-befb-42a2-8f9b-17fd43fc0f7d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:03.129787 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-eae9923f-befb-42a2-8f9b-17fd43fc0f7d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:03.131299 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-eae9923f-befb-42a2-8f9b-17fd43fc0f7d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:03.132399 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-eae9923f-befb-42a2-8f9b-17fd43fc0f7d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1406 microversion: 2.20 time: 0.159057 Nov 24 15:23:03.132955 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 240/450] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:23:02 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:23:03.565622 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-aff6372e-8300-4beb-ba60-b23d917bb2ef tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:03.566135 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-aff6372e-8300-4beb-ba60-b23d917bb2ef tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:03.572434 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-aff6372e-8300-4beb-ba60-b23d917bb2ef tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:03.572888 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-aff6372e-8300-4beb-ba60-b23d917bb2ef tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:03.573658 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-aff6372e-8300-4beb-ba60-b23d917bb2ef tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:03.574089 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-aff6372e-8300-4beb-ba60-b23d917bb2ef tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:03.701860 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-aff6372e-8300-4beb-ba60-b23d917bb2ef tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:03.709232 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-aff6372e-8300-4beb-ba60-b23d917bb2ef tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1675 microversion: 2.1 time: 0.147368 Nov 24 15:23:03.709784 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 211/451] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:03 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:23:04.151421 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a39776dc-0314-49ae-a313-42056c21e15a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:04.152176 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a39776dc-0314-49ae-a313-42056c21e15a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:04.159408 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a39776dc-0314-49ae-a313-42056c21e15a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:04.159853 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a39776dc-0314-49ae-a313-42056c21e15a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:04.160739 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a39776dc-0314-49ae-a313-42056c21e15a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:04.161185 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a39776dc-0314-49ae-a313-42056c21e15a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:04.299997 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a39776dc-0314-49ae-a313-42056c21e15a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:04.307636 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a39776dc-0314-49ae-a313-42056c21e15a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:04.309216 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a39776dc-0314-49ae-a313-42056c21e15a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:04.310302 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a39776dc-0314-49ae-a313-42056c21e15a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1406 microversion: 2.20 time: 0.162892 Nov 24 15:23:04.310879 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 241/452] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:23:04 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:23:04.727162 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-5310c058-2325-46a6-a4a1-8664c7a82dde tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:04.727701 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-5310c058-2325-46a6-a4a1-8664c7a82dde tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:04.733987 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5310c058-2325-46a6-a4a1-8664c7a82dde tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:04.734435 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5310c058-2325-46a6-a4a1-8664c7a82dde tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:04.735247 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5310c058-2325-46a6-a4a1-8664c7a82dde tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:04.735684 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5310c058-2325-46a6-a4a1-8664c7a82dde tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:04.866513 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-5310c058-2325-46a6-a4a1-8664c7a82dde tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:04.874475 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-5310c058-2325-46a6-a4a1-8664c7a82dde tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1675 microversion: 2.1 time: 0.151168 Nov 24 15:23:04.875089 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 212/453] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:04 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:05.328955 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c8a71ace-d2e7-467c-b6c4-52389e2af07e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:05.329465 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c8a71ace-d2e7-467c-b6c4-52389e2af07e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:05.335760 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8a71ace-d2e7-467c-b6c4-52389e2af07e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:05.336208 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8a71ace-d2e7-467c-b6c4-52389e2af07e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:05.336980 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8a71ace-d2e7-467c-b6c4-52389e2af07e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:05.337410 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8a71ace-d2e7-467c-b6c4-52389e2af07e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:05.475103 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c8a71ace-d2e7-467c-b6c4-52389e2af07e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:05.482745 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c8a71ace-d2e7-467c-b6c4-52389e2af07e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:05.484246 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c8a71ace-d2e7-467c-b6c4-52389e2af07e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:05.485339 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c8a71ace-d2e7-467c-b6c4-52389e2af07e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1406 microversion: 2.20 time: 0.160727 Nov 24 15:23:05.485899 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 242/454] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:23:05 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:23:05.892082 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-cc23275c-3324-4a64-a5dd-7809b7909087 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:05.892728 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-cc23275c-3324-4a64-a5dd-7809b7909087 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:05.899300 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cc23275c-3324-4a64-a5dd-7809b7909087 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:05.899745 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cc23275c-3324-4a64-a5dd-7809b7909087 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:05.900522 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cc23275c-3324-4a64-a5dd-7809b7909087 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:05.900955 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cc23275c-3324-4a64-a5dd-7809b7909087 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:06.029797 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-cc23275c-3324-4a64-a5dd-7809b7909087 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:06.037121 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-cc23275c-3324-4a64-a5dd-7809b7909087 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1675 microversion: 2.1 time: 0.149318 Nov 24 15:23:06.037675 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 213/455] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:05 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:06.195459 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-da81e557-9f83-4e39-9470-8f2cab0da5b5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:06.196072 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-da81e557-9f83-4e39-9470-8f2cab0da5b5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:06.202898 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-da81e557-9f83-4e39-9470-8f2cab0da5b5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:06.203350 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-da81e557-9f83-4e39-9470-8f2cab0da5b5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:06.204127 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-da81e557-9f83-4e39-9470-8f2cab0da5b5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:06.204563 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-da81e557-9f83-4e39-9470-8f2cab0da5b5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:06.324763 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-da81e557-9f83-4e39-9470-8f2cab0da5b5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lazy-loading 'services' on Instance uuid 958aee3d-9b1b-4c27-8793-9e280bd9b6d2 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:23:06.432583 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-da81e557-9f83-4e39-9470-8f2cab0da5b5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "DELETE /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2/os-volume_attachments/82a26241-f678-40a9-8fd1-37228e47d28b" status: 202 len: 0 microversion: 2.1 time: 0.240598 Nov 24 15:23:06.433240 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 243/456] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Nov 24 15:23:06 2021] DELETE /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2/os-volume_attachments/82a26241-f678-40a9-8fd1-37228e47d28b => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:06.503019 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4caea9ec-a81e-47f4-9aba-bb8fe70cd83c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:06.503738 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4caea9ec-a81e-47f4-9aba-bb8fe70cd83c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:06.509636 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4caea9ec-a81e-47f4-9aba-bb8fe70cd83c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:06.510076 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4caea9ec-a81e-47f4-9aba-bb8fe70cd83c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:06.510872 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4caea9ec-a81e-47f4-9aba-bb8fe70cd83c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:06.511402 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4caea9ec-a81e-47f4-9aba-bb8fe70cd83c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:06.639632 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4caea9ec-a81e-47f4-9aba-bb8fe70cd83c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:06.647459 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4caea9ec-a81e-47f4-9aba-bb8fe70cd83c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:06.648948 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4caea9ec-a81e-47f4-9aba-bb8fe70cd83c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:06.650042 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4caea9ec-a81e-47f4-9aba-bb8fe70cd83c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1406 microversion: 2.20 time: 0.150662 Nov 24 15:23:06.650590 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 214/457] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:23:06 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:23:07.054995 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ff571664-6777-49c7-9741-d3500cc1a25e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:07.055752 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ff571664-6777-49c7-9741-d3500cc1a25e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:07.061810 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff571664-6777-49c7-9741-d3500cc1a25e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:07.062338 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff571664-6777-49c7-9741-d3500cc1a25e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:07.063153 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff571664-6777-49c7-9741-d3500cc1a25e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:07.063595 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff571664-6777-49c7-9741-d3500cc1a25e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:07.150149 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-168cdcab-0cc9-4a4b-b97e-eb72fc0c08cc req-29b92123-7858-4e6a-ab6e-205a0a5bb011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361e1e6c-853b-4fde-89ed-843a85be79c1", "name": "network-vif-plugged", "status": "completed", "tag": "66d6070e-c6fb-4ac7-8705-204f502bc368"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:07.152280 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:23:07.152280 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:23:07.165010 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-168cdcab-0cc9-4a4b-b97e-eb72fc0c08cc req-29b92123-7858-4e6a-ab6e-205a0a5bb011 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:07.165757 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-168cdcab-0cc9-4a4b-b97e-eb72fc0c08cc req-29b92123-7858-4e6a-ab6e-205a0a5bb011 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:07.178758 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-168cdcab-0cc9-4a4b-b97e-eb72fc0c08cc req-29b92123-7858-4e6a-ab6e-205a0a5bb011 service nova] Creating event network-vif-plugged:66d6070e-c6fb-4ac7-8705-204f502bc368 for instance 361e1e6c-853b-4fde-89ed-843a85be79c1 on hv-cinder-80403 Nov 24 15:23:07.185746 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-168cdcab-0cc9-4a4b-b97e-eb72fc0c08cc req-29b92123-7858-4e6a-ab6e-205a0a5bb011 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038288 Nov 24 15:23:07.186837 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 215/458] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:23:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:23:07.218998 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ff571664-6777-49c7-9741-d3500cc1a25e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:07.226775 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ff571664-6777-49c7-9741-d3500cc1a25e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1675 microversion: 2.1 time: 0.175816 Nov 24 15:23:07.228287 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 244/459] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:07 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:07.541507 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3210a5e1-ec00-45ae-83f9-4731b15aeefc tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:07.542084 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3210a5e1-ec00-45ae-83f9-4731b15aeefc tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:07.548167 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3210a5e1-ec00-45ae-83f9-4731b15aeefc tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:07.548612 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3210a5e1-ec00-45ae-83f9-4731b15aeefc tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:07.549379 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3210a5e1-ec00-45ae-83f9-4731b15aeefc tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:07.549844 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3210a5e1-ec00-45ae-83f9-4731b15aeefc tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:07.574089 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3210a5e1-ec00-45ae-83f9-4731b15aeefc tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Going to try to terminate instance {{(pid=116073) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:23:07.649430 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3210a5e1-ec00-45ae-83f9-4731b15aeefc tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "DELETE /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 204 len: 0 microversion: 2.1 time: 0.111627 Nov 24 15:23:07.650206 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 216/460] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:23:07 2021] DELETE /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:23:07.658148 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d8364937-2980-4cae-b052-2a718bc4bb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:07.658775 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d8364937-2980-4cae-b052-2a718bc4bb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:07.665045 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d8364937-2980-4cae-b052-2a718bc4bb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:07.665491 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d8364937-2980-4cae-b052-2a718bc4bb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:07.666274 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d8364937-2980-4cae-b052-2a718bc4bb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:07.666709 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d8364937-2980-4cae-b052-2a718bc4bb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:07.668693 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6585ce32-0454-48e5-90e7-a00149ada711 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:07.669879 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6585ce32-0454-48e5-90e7-a00149ada711 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:07.675506 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6585ce32-0454-48e5-90e7-a00149ada711 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:07.675950 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6585ce32-0454-48e5-90e7-a00149ada711 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:07.676727 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6585ce32-0454-48e5-90e7-a00149ada711 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:07.677163 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6585ce32-0454-48e5-90e7-a00149ada711 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:07.863209 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d8364937-2980-4cae-b052-2a718bc4bb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:07.866829 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6585ce32-0454-48e5-90e7-a00149ada711 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:07.870877 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d8364937-2980-4cae-b052-2a718bc4bb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 200 len: 1513 microversion: 2.1 time: 0.216315 Nov 24 15:23:07.871329 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 245/461] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:07 2021] GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:07.874746 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6585ce32-0454-48e5-90e7-a00149ada711 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:07.876257 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6585ce32-0454-48e5-90e7-a00149ada711 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:07.877345 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6585ce32-0454-48e5-90e7-a00149ada711 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1406 microversion: 2.20 time: 0.212729 Nov 24 15:23:07.877878 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 217/462] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:23:07 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:23:08.245768 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c2349f5f-8b5c-43ea-b987-6eef623b569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:08.246373 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c2349f5f-8b5c-43ea-b987-6eef623b569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:08.252315 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c2349f5f-8b5c-43ea-b987-6eef623b569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:08.252766 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c2349f5f-8b5c-43ea-b987-6eef623b569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:08.253539 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c2349f5f-8b5c-43ea-b987-6eef623b569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:08.253972 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c2349f5f-8b5c-43ea-b987-6eef623b569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:08.380861 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c2349f5f-8b5c-43ea-b987-6eef623b569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:08.388540 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c2349f5f-8b5c-43ea-b987-6eef623b569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1675 microversion: 2.1 time: 0.145962 Nov 24 15:23:08.389106 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 246/463] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:08 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:08.887870 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2adad34f-5003-415d-b7b7-a207689d6d4d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:08.888553 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2adad34f-5003-415d-b7b7-a207689d6d4d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:08.894224 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ed749104-6990-43cd-91d1-36e641a30886 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:08.894856 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ed749104-6990-43cd-91d1-36e641a30886 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:08.895234 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2adad34f-5003-415d-b7b7-a207689d6d4d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:08.895677 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2adad34f-5003-415d-b7b7-a207689d6d4d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:08.896450 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2adad34f-5003-415d-b7b7-a207689d6d4d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:08.896882 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2adad34f-5003-415d-b7b7-a207689d6d4d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:08.901050 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ed749104-6990-43cd-91d1-36e641a30886 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:08.901502 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ed749104-6990-43cd-91d1-36e641a30886 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:08.902295 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ed749104-6990-43cd-91d1-36e641a30886 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:08.902727 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ed749104-6990-43cd-91d1-36e641a30886 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:09.088263 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-2adad34f-5003-415d-b7b7-a207689d6d4d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:09.092385 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ed749104-6990-43cd-91d1-36e641a30886 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:09.095892 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2adad34f-5003-415d-b7b7-a207689d6d4d tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 200 len: 1513 microversion: 2.1 time: 0.211647 Nov 24 15:23:09.096550 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 218/464] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:08 2021] GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:09.101081 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ed749104-6990-43cd-91d1-36e641a30886 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:09.102568 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ed749104-6990-43cd-91d1-36e641a30886 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:09.103739 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ed749104-6990-43cd-91d1-36e641a30886 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1597 microversion: 2.20 time: 0.213155 Nov 24 15:23:09.104288 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 247/465] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:23:08 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1597 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:23:09.121690 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-0b1253d2-8c8f-4b46-aa58-64b969ea4f8d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:09.122162 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-0b1253d2-8c8f-4b46-aa58-64b969ea4f8d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:09.128601 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0b1253d2-8c8f-4b46-aa58-64b969ea4f8d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:09.129053 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0b1253d2-8c8f-4b46-aa58-64b969ea4f8d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:09.129832 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0b1253d2-8c8f-4b46-aa58-64b969ea4f8d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:09.130268 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0b1253d2-8c8f-4b46-aa58-64b969ea4f8d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:09.209226 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-0b1253d2-8c8f-4b46-aa58-64b969ea4f8d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091156 Nov 24 15:23:09.209831 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 219/466] 10.222.0.66 () {60 vars in 1315 bytes} [Wed Nov 24 15:23:09 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:23:09.405339 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-09476ce1-e1c0-4b86-a9ef-9e1c320b9bc1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:09.405980 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-09476ce1-e1c0-4b86-a9ef-9e1c320b9bc1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:09.412021 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-09476ce1-e1c0-4b86-a9ef-9e1c320b9bc1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:09.412567 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-09476ce1-e1c0-4b86-a9ef-9e1c320b9bc1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:09.413352 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-09476ce1-e1c0-4b86-a9ef-9e1c320b9bc1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:09.413786 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-09476ce1-e1c0-4b86-a9ef-9e1c320b9bc1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:09.894991 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-09476ce1-e1c0-4b86-a9ef-9e1c320b9bc1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:09.911597 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-09476ce1-e1c0-4b86-a9ef-9e1c320b9bc1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1675 microversion: 2.1 time: 0.508051 Nov 24 15:23:09.923791 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 248/467] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:09 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1675 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:10.092728 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-4aff31e6-47c0-4416-acdc-45863989819b req-53d695da-4072-4d7e-9154-e8036bfe6aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "958aee3d-9b1b-4c27-8793-9e280bd9b6d2", "name": "network-vif-deleted", "tag": "66c8ad52-c206-4ee5-aada-df62148b7eb9"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:10.094270 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:23:10.094270 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:23:10.101737 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-4aff31e6-47c0-4416-acdc-45863989819b req-53d695da-4072-4d7e-9154-e8036bfe6aac service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:10.102181 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-4aff31e6-47c0-4416-acdc-45863989819b req-53d695da-4072-4d7e-9154-e8036bfe6aac service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:10.114216 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1ed116ff-e3d2-42aa-85ec-da87697f7270 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:10.114953 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1ed116ff-e3d2-42aa-85ec-da87697f7270 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:10.115115 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-4aff31e6-47c0-4416-acdc-45863989819b req-53d695da-4072-4d7e-9154-e8036bfe6aac service nova] Creating event network-vif-deleted:66c8ad52-c206-4ee5-aada-df62148b7eb9 for instance 958aee3d-9b1b-4c27-8793-9e280bd9b6d2 on hv-cinder-80403 Nov 24 15:23:10.120620 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-4aff31e6-47c0-4416-acdc-45863989819b req-53d695da-4072-4d7e-9154-e8036bfe6aac service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032386 Nov 24 15:23:10.124154 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ed116ff-e3d2-42aa-85ec-da87697f7270 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:10.124613 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ed116ff-e3d2-42aa-85ec-da87697f7270 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:10.125410 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ed116ff-e3d2-42aa-85ec-da87697f7270 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:10.125849 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ed116ff-e3d2-42aa-85ec-da87697f7270 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:10.127690 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 220/468] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:23:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:23:10.222599 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1ed116ff-e3d2-42aa-85ec-da87697f7270 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:10.230508 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1ed116ff-e3d2-42aa-85ec-da87697f7270 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 200 len: 1304 microversion: 2.1 time: 0.120919 Nov 24 15:23:10.231133 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 249/469] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:10 2021] GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:23:10.540937 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-e4beec0a-f671-4352-8723-32a07689ce77 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:10.541937 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-e4beec0a-f671-4352-8723-32a07689ce77 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:10.543747 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-7fee827a-3cc3-4f04-a183-d1c049c82731 req-3227073d-8a4f-4369-b816-acd7c44b4bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361e1e6c-853b-4fde-89ed-843a85be79c1", "tag": "66d6070e-c6fb-4ac7-8705-204f502bc368"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:10.545453 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:23:10.545453 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:23:10.551561 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e4beec0a-f671-4352-8723-32a07689ce77 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:10.552008 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e4beec0a-f671-4352-8723-32a07689ce77 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:10.552813 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e4beec0a-f671-4352-8723-32a07689ce77 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:10.553224 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e4beec0a-f671-4352-8723-32a07689ce77 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:10.553491 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7fee827a-3cc3-4f04-a183-d1c049c82731 req-3227073d-8a4f-4369-b816-acd7c44b4bae service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:10.554036 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-7fee827a-3cc3-4f04-a183-d1c049c82731 req-3227073d-8a4f-4369-b816-acd7c44b4bae service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:10.574303 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-7fee827a-3cc3-4f04-a183-d1c049c82731 req-3227073d-8a4f-4369-b816-acd7c44b4bae service nova] Creating event network-changed:66d6070e-c6fb-4ac7-8705-204f502bc368 for instance 361e1e6c-853b-4fde-89ed-843a85be79c1 on hv-cinder-80403 Nov 24 15:23:10.582504 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-7fee827a-3cc3-4f04-a183-d1c049c82731 req-3227073d-8a4f-4369-b816-acd7c44b4bae service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042656 Nov 24 15:23:10.583386 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 250/470] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:23:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:23:10.625361 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-e4beec0a-f671-4352-8723-32a07689ce77 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 14 microversion: 2.20 time: 0.088406 Nov 24 15:23:10.626009 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 221/471] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:10 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:10.929806 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cdca079b-4e3b-4928-a79b-d2660a18dc7f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:10.930629 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cdca079b-4e3b-4928-a79b-d2660a18dc7f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:10.937429 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cdca079b-4e3b-4928-a79b-d2660a18dc7f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:10.937898 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cdca079b-4e3b-4928-a79b-d2660a18dc7f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:10.938674 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cdca079b-4e3b-4928-a79b-d2660a18dc7f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:10.939473 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cdca079b-4e3b-4928-a79b-d2660a18dc7f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:11.086767 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cdca079b-4e3b-4928-a79b-d2660a18dc7f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:11.094604 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cdca079b-4e3b-4928-a79b-d2660a18dc7f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1675 microversion: 2.1 time: 0.168742 Nov 24 15:23:11.095217 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 251/472] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:10 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:11.248681 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-342b865d-2ae2-42d8-bd32-bc6221e3fcfb tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:11.249412 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-342b865d-2ae2-42d8-bd32-bc6221e3fcfb tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: 958aee3d-9b1b-4c27-8793-9e280bd9b6d2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:11.256441 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-342b865d-2ae2-42d8-bd32-bc6221e3fcfb tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:11.256890 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-342b865d-2ae2-42d8-bd32-bc6221e3fcfb tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:11.257668 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-342b865d-2ae2-42d8-bd32-bc6221e3fcfb tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:11.258102 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-342b865d-2ae2-42d8-bd32-bc6221e3fcfb tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:11.276535 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-342b865d-2ae2-42d8-bd32-bc6221e3fcfb tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] HTTP exception thrown: Instance 958aee3d-9b1b-4c27-8793-9e280bd9b6d2 could not be found. Nov 24 15:23:11.277051 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-342b865d-2ae2-42d8-bd32-bc6221e3fcfb tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Returning 404 to user: Instance 958aee3d-9b1b-4c27-8793-9e280bd9b6d2 could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:23:11.277875 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-342b865d-2ae2-42d8-bd32-bc6221e3fcfb tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2" status: 404 len: 111 microversion: 2.1 time: 0.033250 Nov 24 15:23:11.278421 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 222/473] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:11 2021] GET /compute/v2.1/servers/958aee3d-9b1b-4c27-8793-9e280bd9b6d2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:23:11.636410 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fbec2943-0179-4b93-9e92-1a570c5bf603 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:11.637358 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fbec2943-0179-4b93-9e92-1a570c5bf603 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:11.643801 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fbec2943-0179-4b93-9e92-1a570c5bf603 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:11.644243 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fbec2943-0179-4b93-9e92-1a570c5bf603 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:11.645020 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fbec2943-0179-4b93-9e92-1a570c5bf603 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:11.645447 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fbec2943-0179-4b93-9e92-1a570c5bf603 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:12.112073 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f908165f-95ef-404e-99b3-76fbf59c81d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:12.112673 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-f908165f-95ef-404e-99b3-76fbf59c81d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:12.119515 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f908165f-95ef-404e-99b3-76fbf59c81d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:12.119956 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f908165f-95ef-404e-99b3-76fbf59c81d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:12.120722 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f908165f-95ef-404e-99b3-76fbf59c81d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:12.121150 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f908165f-95ef-404e-99b3-76fbf59c81d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:12.251483 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-f908165f-95ef-404e-99b3-76fbf59c81d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:12.258831 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f908165f-95ef-404e-99b3-76fbf59c81d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1675 microversion: 2.1 time: 0.150425 Nov 24 15:23:12.259383 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 223/474] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:12 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:13.275710 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-096201e7-510b-4520-8c5b-cd0a9647707b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:13.276309 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-096201e7-510b-4520-8c5b-cd0a9647707b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:13.283083 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-096201e7-510b-4520-8c5b-cd0a9647707b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:13.283520 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-096201e7-510b-4520-8c5b-cd0a9647707b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:13.284285 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-096201e7-510b-4520-8c5b-cd0a9647707b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:13.284716 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-096201e7-510b-4520-8c5b-cd0a9647707b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:13.411674 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-096201e7-510b-4520-8c5b-cd0a9647707b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:13.418900 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-096201e7-510b-4520-8c5b-cd0a9647707b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1675 microversion: 2.1 time: 0.146909 Nov 24 15:23:13.419519 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 224/475] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:13 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:23:14.436433 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-367e3055-13f7-41e7-ac19-29afcc90a1ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:14.437118 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-367e3055-13f7-41e7-ac19-29afcc90a1ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:14.443252 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-367e3055-13f7-41e7-ac19-29afcc90a1ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:14.443719 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-367e3055-13f7-41e7-ac19-29afcc90a1ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:14.444478 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-367e3055-13f7-41e7-ac19-29afcc90a1ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:14.444915 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-367e3055-13f7-41e7-ac19-29afcc90a1ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:14.461993 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fbec2943-0179-4b93-9e92-1a570c5bf603 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 14 microversion: 2.20 time: 2.829245 Nov 24 15:23:14.462984 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 252/476] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:11 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 14 bytes in 2831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:14.580830 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-367e3055-13f7-41e7-ac19-29afcc90a1ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:14.588529 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-367e3055-13f7-41e7-ac19-29afcc90a1ab tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1675 microversion: 2.1 time: 0.155793 Nov 24 15:23:14.589140 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 225/477] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:14 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:23:15.474149 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0f89f11c-64a3-4011-bf89-0d2a0ba77297 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:15.475093 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0f89f11c-64a3-4011-bf89-0d2a0ba77297 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:15.481913 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0f89f11c-64a3-4011-bf89-0d2a0ba77297 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:15.483031 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0f89f11c-64a3-4011-bf89-0d2a0ba77297 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:15.483856 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0f89f11c-64a3-4011-bf89-0d2a0ba77297 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:15.484321 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0f89f11c-64a3-4011-bf89-0d2a0ba77297 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:15.546421 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0f89f11c-64a3-4011-bf89-0d2a0ba77297 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 14 microversion: 2.20 time: 0.076299 Nov 24 15:23:15.549519 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 253/478] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:15 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:15.604947 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6e1573ec-5d58-432a-86cf-9df884e6c28e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:15.605554 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6e1573ec-5d58-432a-86cf-9df884e6c28e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:15.611891 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6e1573ec-5d58-432a-86cf-9df884e6c28e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:15.612338 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6e1573ec-5d58-432a-86cf-9df884e6c28e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:15.613116 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6e1573ec-5d58-432a-86cf-9df884e6c28e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:15.613551 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6e1573ec-5d58-432a-86cf-9df884e6c28e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:15.755262 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6e1573ec-5d58-432a-86cf-9df884e6c28e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:15.762566 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6e1573ec-5d58-432a-86cf-9df884e6c28e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1652 microversion: 2.1 time: 0.161188 Nov 24 15:23:15.763148 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 226/479] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:15 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1652 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:15.780377 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a3893a76-4b55-4899-abc3-d95ea3efd784 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:15.787202 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a3893a76-4b55-4899-abc3-d95ea3efd784 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:15.787649 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a3893a76-4b55-4899-abc3-d95ea3efd784 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:15.810167 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a3893a76-4b55-4899-abc3-d95ea3efd784 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Going to try to start instance {{(pid=116072) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 24 15:23:15.855348 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a3893a76-4b55-4899-abc3-d95ea3efd784 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action" status: 202 len: 0 microversion: 2.1 time: 0.079513 Nov 24 15:23:15.856016 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 254/480] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:23:15 2021] POST /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:15.864696 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-582fa261-edde-4d3c-94db-00d81a78dd4f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:15.865435 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-582fa261-edde-4d3c-94db-00d81a78dd4f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:15.871788 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-582fa261-edde-4d3c-94db-00d81a78dd4f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:15.872288 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-582fa261-edde-4d3c-94db-00d81a78dd4f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:15.873150 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-582fa261-edde-4d3c-94db-00d81a78dd4f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:15.873588 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-582fa261-edde-4d3c-94db-00d81a78dd4f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:16.011893 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-582fa261-edde-4d3c-94db-00d81a78dd4f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:16.019812 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-582fa261-edde-4d3c-94db-00d81a78dd4f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1661 microversion: 2.1 time: 0.158896 Nov 24 15:23:16.020550 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 227/481] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:15 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1661 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:23:16.558313 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ad9236ed-8216-4e11-bf68-8d54346d3120 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:16.559210 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ad9236ed-8216-4e11-bf68-8d54346d3120 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:16.565049 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ad9236ed-8216-4e11-bf68-8d54346d3120 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:16.565492 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ad9236ed-8216-4e11-bf68-8d54346d3120 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:16.566258 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ad9236ed-8216-4e11-bf68-8d54346d3120 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:16.566685 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ad9236ed-8216-4e11-bf68-8d54346d3120 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:16.637522 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ad9236ed-8216-4e11-bf68-8d54346d3120 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 14 microversion: 2.20 time: 0.083708 Nov 24 15:23:16.638130 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 255/482] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:16 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:17.039976 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-fb448d63-0ba9-4154-80c1-355667c87595 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:17.040564 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-fb448d63-0ba9-4154-80c1-355667c87595 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:17.049177 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fb448d63-0ba9-4154-80c1-355667c87595 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:17.049628 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fb448d63-0ba9-4154-80c1-355667c87595 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:17.050420 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fb448d63-0ba9-4154-80c1-355667c87595 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:17.050883 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fb448d63-0ba9-4154-80c1-355667c87595 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:17.181835 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-fb448d63-0ba9-4154-80c1-355667c87595 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:17.189778 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-fb448d63-0ba9-4154-80c1-355667c87595 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1665 microversion: 2.1 time: 0.153739 Nov 24 15:23:17.190345 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 228/483] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:17 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:17.648389 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5d25307e-5d08-4b31-926f-c4e2bebff0c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:17.649374 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5d25307e-5d08-4b31-926f-c4e2bebff0c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:17.656664 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5d25307e-5d08-4b31-926f-c4e2bebff0c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:17.657115 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5d25307e-5d08-4b31-926f-c4e2bebff0c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:17.657894 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5d25307e-5d08-4b31-926f-c4e2bebff0c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:17.658325 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5d25307e-5d08-4b31-926f-c4e2bebff0c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:19.873552 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5d25307e-5d08-4b31-926f-c4e2bebff0c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 14 microversion: 2.20 time: 2.229042 Nov 24 15:23:19.874192 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 256/484] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:17 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 14 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:20.884342 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c6c19fd4-6a3f-4f3e-88c6-ad28d9971add tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:20.885254 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c6c19fd4-6a3f-4f3e-88c6-ad28d9971add tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:20.891565 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c6c19fd4-6a3f-4f3e-88c6-ad28d9971add tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:20.892011 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c6c19fd4-6a3f-4f3e-88c6-ad28d9971add tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:20.892782 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c6c19fd4-6a3f-4f3e-88c6-ad28d9971add tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:20.893214 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c6c19fd4-6a3f-4f3e-88c6-ad28d9971add tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:20.959204 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c6c19fd4-6a3f-4f3e-88c6-ad28d9971add tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 14 microversion: 2.20 time: 0.078289 Nov 24 15:23:20.961336 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 229/485] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:20 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:21.091902 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-272523927", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452", "networks": [{"uuid": "ed93d9af-072f-4552-ba1e-667ff4d62fac"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:21.143202 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] validate_networks() for [('ed93d9af-072f-4552-ba1e-667ff4d62fac', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:23:21.478650 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:23:21.479095 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:23:21.479562 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:23:21.479967 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:23:21.480371 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:23:21.489692 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:21.490134 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:21.490974 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:21.491435 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:21.507254 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Getting quotas for project 043d05ede00543d285fddc5f601117c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:23:21.511497 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Getting quotas for user 1c4128eac441411e9114acc0b6395f17 and project 043d05ede00543d285fddc5f601117c9. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:23:21.524518 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:23:21.526996 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:23:21.571591 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-32a0668d-f3b3-4f77-a92e-f1aadd766001 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483667 Nov 24 15:23:21.572541 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 257/486] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:23:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:23:21.582993 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6bef8867-56ec-4588-98a1-c8f131aa560f tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:21.583691 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6bef8867-56ec-4588-98a1-c8f131aa560f tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:21.637946 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6bef8867-56ec-4588-98a1-c8f131aa560f tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:21.644921 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6bef8867-56ec-4588-98a1-c8f131aa560f tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e" status: 200 len: 1218 microversion: 2.1 time: 0.065847 Nov 24 15:23:21.645416 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 230/487] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:21 2021] GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:21.970358 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9ff4d9a9-c942-439b-9131-5c52efe21a63 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:21.971363 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9ff4d9a9-c942-439b-9131-5c52efe21a63 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:21.978913 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ff4d9a9-c942-439b-9131-5c52efe21a63 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:21.979368 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ff4d9a9-c942-439b-9131-5c52efe21a63 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:21.980149 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ff4d9a9-c942-439b-9131-5c52efe21a63 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:21.980587 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ff4d9a9-c942-439b-9131-5c52efe21a63 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:22.075550 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9ff4d9a9-c942-439b-9131-5c52efe21a63 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 6451 microversion: 2.20 time: 0.108697 Nov 24 15:23:22.080052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 258/488] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:21 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 6451 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:23:22.661642 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-854263c4-14ac-4315-90c4-6d02c63a6769 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:22.662246 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-854263c4-14ac-4315-90c4-6d02c63a6769 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:22.668969 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-854263c4-14ac-4315-90c4-6d02c63a6769 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:22.669421 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-854263c4-14ac-4315-90c4-6d02c63a6769 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:22.670200 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-854263c4-14ac-4315-90c4-6d02c63a6769 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:22.670632 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-854263c4-14ac-4315-90c4-6d02c63a6769 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:22.730431 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-854263c4-14ac-4315-90c4-6d02c63a6769 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:22.738212 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-854263c4-14ac-4315-90c4-6d02c63a6769 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e" status: 200 len: 1276 microversion: 2.1 time: 0.080290 Nov 24 15:23:22.738773 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 231/489] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:22 2021] GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e => generated 1276 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:23.088290 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d4f86759-13a0-4c83-b25b-aa53c6a7938c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:23.089307 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d4f86759-13a0-4c83-b25b-aa53c6a7938c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:23.096467 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d4f86759-13a0-4c83-b25b-aa53c6a7938c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:23.096925 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d4f86759-13a0-4c83-b25b-aa53c6a7938c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:23.097714 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d4f86759-13a0-4c83-b25b-aa53c6a7938c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:23.098155 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d4f86759-13a0-4c83-b25b-aa53c6a7938c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:23.178432 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d4f86759-13a0-4c83-b25b-aa53c6a7938c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 15025 microversion: 2.20 time: 0.094127 Nov 24 15:23:23.179124 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 259/490] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:23 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 15025 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:23.724086 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-0d9e1296-c7f5-4374-8ed9-23a4c1ea948e req-08b4062e-11f0-406b-b7b1-55933c7d65c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e", "tag": "0de4531c-4f51-49ee-94c1-761f6aeffde1"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:23.727439 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:23:23.727439 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:23:23.734629 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-0d9e1296-c7f5-4374-8ed9-23a4c1ea948e req-08b4062e-11f0-406b-b7b1-55933c7d65c8 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:23.735088 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-0d9e1296-c7f5-4374-8ed9-23a4c1ea948e req-08b4062e-11f0-406b-b7b1-55933c7d65c8 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:23.753882 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-0d9e1296-c7f5-4374-8ed9-23a4c1ea948e req-08b4062e-11f0-406b-b7b1-55933c7d65c8 service nova] Creating event network-changed:0de4531c-4f51-49ee-94c1-761f6aeffde1 for instance b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e on hv-cinder-80403 Nov 24 15:23:23.758027 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f28b253c-bd81-46ff-9552-a646836412df tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:23.758854 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f28b253c-bd81-46ff-9552-a646836412df tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:23.759036 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-0d9e1296-c7f5-4374-8ed9-23a4c1ea948e req-08b4062e-11f0-406b-b7b1-55933c7d65c8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038385 Nov 24 15:23:23.759552 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 232/491] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:23:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:23:23.766881 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f28b253c-bd81-46ff-9552-a646836412df tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:23.767330 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f28b253c-bd81-46ff-9552-a646836412df tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:23.768108 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f28b253c-bd81-46ff-9552-a646836412df tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:23.768565 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f28b253c-bd81-46ff-9552-a646836412df tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:23.906510 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f28b253c-bd81-46ff-9552-a646836412df tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:23.913842 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f28b253c-bd81-46ff-9552-a646836412df tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e" status: 200 len: 1318 microversion: 2.1 time: 0.160214 Nov 24 15:23:23.914409 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 260/492] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:23 2021] GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:23:24.190667 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6bb451f4-9169-4f03-8cd3-b12504c98a47 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:24.191695 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6bb451f4-9169-4f03-8cd3-b12504c98a47 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:24.197733 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6bb451f4-9169-4f03-8cd3-b12504c98a47 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:24.198192 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6bb451f4-9169-4f03-8cd3-b12504c98a47 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:24.199041 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6bb451f4-9169-4f03-8cd3-b12504c98a47 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:24.199460 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6bb451f4-9169-4f03-8cd3-b12504c98a47 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:24.290639 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6bb451f4-9169-4f03-8cd3-b12504c98a47 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 18155 microversion: 2.20 time: 0.104153 Nov 24 15:23:24.294527 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 233/493] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:24 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 18155 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:24.932070 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-879f05f6-7a8d-4aa1-af78-9a1a53418c44 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:24.932607 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-879f05f6-7a8d-4aa1-af78-9a1a53418c44 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:24.939378 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-879f05f6-7a8d-4aa1-af78-9a1a53418c44 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:24.939827 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-879f05f6-7a8d-4aa1-af78-9a1a53418c44 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:24.940599 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-879f05f6-7a8d-4aa1-af78-9a1a53418c44 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:24.941031 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-879f05f6-7a8d-4aa1-af78-9a1a53418c44 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:25.069199 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-879f05f6-7a8d-4aa1-af78-9a1a53418c44 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:25.076946 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-879f05f6-7a8d-4aa1-af78-9a1a53418c44 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e" status: 200 len: 1318 microversion: 2.1 time: 0.148616 Nov 24 15:23:25.077518 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 261/494] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:24 2021] GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:25.302787 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-28aa5190-0da3-4b9c-beef-c2d6e154a7d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:25.303831 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-28aa5190-0da3-4b9c-beef-c2d6e154a7d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:25.311284 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-28aa5190-0da3-4b9c-beef-c2d6e154a7d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:25.311731 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-28aa5190-0da3-4b9c-beef-c2d6e154a7d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:25.312504 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-28aa5190-0da3-4b9c-beef-c2d6e154a7d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:25.312938 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-28aa5190-0da3-4b9c-beef-c2d6e154a7d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:25.380697 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-28aa5190-0da3-4b9c-beef-c2d6e154a7d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 19342 microversion: 2.20 time: 0.081864 Nov 24 15:23:25.381309 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 234/495] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:25 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 19342 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:26.093892 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7d1e1395-bb5b-4272-97e7-e8333bacf9c5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:26.094497 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7d1e1395-bb5b-4272-97e7-e8333bacf9c5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:26.100770 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d1e1395-bb5b-4272-97e7-e8333bacf9c5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:26.101213 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d1e1395-bb5b-4272-97e7-e8333bacf9c5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:26.101980 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d1e1395-bb5b-4272-97e7-e8333bacf9c5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:26.102409 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7d1e1395-bb5b-4272-97e7-e8333bacf9c5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:26.233618 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7d1e1395-bb5b-4272-97e7-e8333bacf9c5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:26.241369 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7d1e1395-bb5b-4272-97e7-e8333bacf9c5 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e" status: 200 len: 1318 microversion: 2.1 time: 0.151790 Nov 24 15:23:26.241926 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 262/496] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:26 2021] GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:26.393190 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-88e899bf-8c8f-4214-8be0-50d5faccb52c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:26.394115 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-88e899bf-8c8f-4214-8be0-50d5faccb52c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:26.400978 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-88e899bf-8c8f-4214-8be0-50d5faccb52c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:26.401439 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-88e899bf-8c8f-4214-8be0-50d5faccb52c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:26.402195 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-88e899bf-8c8f-4214-8be0-50d5faccb52c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:26.402631 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-88e899bf-8c8f-4214-8be0-50d5faccb52c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:26.479503 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-88e899bf-8c8f-4214-8be0-50d5faccb52c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 22070 microversion: 2.20 time: 0.090861 Nov 24 15:23:26.480372 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 235/497] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:26 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 22070 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:27.257802 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9e030874-983a-4eff-9c88-2d1280019748 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:27.258440 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9e030874-983a-4eff-9c88-2d1280019748 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:27.264912 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9e030874-983a-4eff-9c88-2d1280019748 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:27.265361 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9e030874-983a-4eff-9c88-2d1280019748 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:27.266146 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9e030874-983a-4eff-9c88-2d1280019748 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:27.266580 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9e030874-983a-4eff-9c88-2d1280019748 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:27.397797 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9e030874-983a-4eff-9c88-2d1280019748 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:27.405694 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9e030874-983a-4eff-9c88-2d1280019748 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e" status: 200 len: 1318 microversion: 2.1 time: 0.152082 Nov 24 15:23:27.406247 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 263/498] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:27 2021] GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:27.491619 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c909c7ef-b5c3-476d-877d-199bc87a5f49 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:27.492604 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c909c7ef-b5c3-476d-877d-199bc87a5f49 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:27.501149 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c909c7ef-b5c3-476d-877d-199bc87a5f49 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:27.501599 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c909c7ef-b5c3-476d-877d-199bc87a5f49 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:27.502376 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c909c7ef-b5c3-476d-877d-199bc87a5f49 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:27.502826 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c909c7ef-b5c3-476d-877d-199bc87a5f49 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:27.575106 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c909c7ef-b5c3-476d-877d-199bc87a5f49 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 23235 microversion: 2.20 time: 0.087595 Nov 24 15:23:27.576291 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 236/499] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:27 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 23235 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:28.422443 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1b322741-eda6-4bee-99e8-8664d379f3fe tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:28.423204 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1b322741-eda6-4bee-99e8-8664d379f3fe tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:28.429496 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1b322741-eda6-4bee-99e8-8664d379f3fe tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:28.429939 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1b322741-eda6-4bee-99e8-8664d379f3fe tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:28.430735 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1b322741-eda6-4bee-99e8-8664d379f3fe tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:28.431186 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1b322741-eda6-4bee-99e8-8664d379f3fe tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:28.559193 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1b322741-eda6-4bee-99e8-8664d379f3fe tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:28.566288 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1b322741-eda6-4bee-99e8-8664d379f3fe tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e" status: 200 len: 1318 microversion: 2.1 time: 0.147615 Nov 24 15:23:28.566864 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 264/500] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:28 2021] GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:28.587446 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b2e8c65e-34f6-400b-b207-444c8db75684 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:28.588469 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b2e8c65e-34f6-400b-b207-444c8db75684 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:28.595901 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b2e8c65e-34f6-400b-b207-444c8db75684 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:28.596352 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b2e8c65e-34f6-400b-b207-444c8db75684 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:28.597121 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b2e8c65e-34f6-400b-b207-444c8db75684 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:28.597551 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b2e8c65e-34f6-400b-b207-444c8db75684 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:28.670824 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b2e8c65e-34f6-400b-b207-444c8db75684 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 24834 microversion: 2.20 time: 0.087332 Nov 24 15:23:28.671446 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 237/501] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:28 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 24834 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:29.282774 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-b889828d-0eae-444f-924d-c442b420e011 req-db23b36c-9f5e-4556-ba32-288c48353534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e", "name": "network-vif-plugged", "status": "completed", "tag": "0de4531c-4f51-49ee-94c1-761f6aeffde1"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:29.284307 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:23:29.284307 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:23:29.291329 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-b889828d-0eae-444f-924d-c442b420e011 req-db23b36c-9f5e-4556-ba32-288c48353534 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:29.291770 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-b889828d-0eae-444f-924d-c442b420e011 req-db23b36c-9f5e-4556-ba32-288c48353534 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:29.303209 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-b889828d-0eae-444f-924d-c442b420e011 req-db23b36c-9f5e-4556-ba32-288c48353534 service nova] Creating event network-vif-plugged:0de4531c-4f51-49ee-94c1-761f6aeffde1 for instance b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e on hv-cinder-80403 Nov 24 15:23:29.308048 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-b889828d-0eae-444f-924d-c442b420e011 req-db23b36c-9f5e-4556-ba32-288c48353534 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028844 Nov 24 15:23:29.308640 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 265/502] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:23:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:23:29.584113 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ff971a74-6b91-4336-a7c6-b3e71cf592a0 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:29.584820 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ff971a74-6b91-4336-a7c6-b3e71cf592a0 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:29.592273 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff971a74-6b91-4336-a7c6-b3e71cf592a0 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:29.592878 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff971a74-6b91-4336-a7c6-b3e71cf592a0 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:29.593460 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff971a74-6b91-4336-a7c6-b3e71cf592a0 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:29.593891 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff971a74-6b91-4336-a7c6-b3e71cf592a0 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:29.683000 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-abf55b0b-9e8f-49b7-9d6a-a4f02815a22e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:29.684121 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-abf55b0b-9e8f-49b7-9d6a-a4f02815a22e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:29.690622 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-abf55b0b-9e8f-49b7-9d6a-a4f02815a22e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:29.691106 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-abf55b0b-9e8f-49b7-9d6a-a4f02815a22e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:29.691886 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-abf55b0b-9e8f-49b7-9d6a-a4f02815a22e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:29.692319 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-abf55b0b-9e8f-49b7-9d6a-a4f02815a22e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:29.728523 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ff971a74-6b91-4336-a7c6-b3e71cf592a0 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:29.736459 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ff971a74-6b91-4336-a7c6-b3e71cf592a0 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e" status: 200 len: 1318 microversion: 2.1 time: 0.156405 Nov 24 15:23:29.737020 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 238/503] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:29 2021] GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:29.771352 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-abf55b0b-9e8f-49b7-9d6a-a4f02815a22e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 26323 microversion: 2.20 time: 0.092280 Nov 24 15:23:29.771994 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 266/504] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:29 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 26323 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:30.753970 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-07178b2c-783d-4670-9e50-4f90699a4ed7 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:30.754563 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-07178b2c-783d-4670-9e50-4f90699a4ed7 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:30.760889 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-07178b2c-783d-4670-9e50-4f90699a4ed7 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:30.761365 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-07178b2c-783d-4670-9e50-4f90699a4ed7 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:30.762141 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-07178b2c-783d-4670-9e50-4f90699a4ed7 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:30.762569 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-07178b2c-783d-4670-9e50-4f90699a4ed7 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:30.783493 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-28ef6f51-3d13-418b-a476-c5587bd49be8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:30.784519 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-28ef6f51-3d13-418b-a476-c5587bd49be8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:30.791258 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-28ef6f51-3d13-418b-a476-c5587bd49be8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:30.791714 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-28ef6f51-3d13-418b-a476-c5587bd49be8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:30.792502 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-28ef6f51-3d13-418b-a476-c5587bd49be8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:30.792937 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-28ef6f51-3d13-418b-a476-c5587bd49be8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:30.881663 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-28ef6f51-3d13-418b-a476-c5587bd49be8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 27196 microversion: 2.20 time: 0.102064 Nov 24 15:23:30.885640 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 267/505] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:30 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 27196 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 15:23:30.893351 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-07178b2c-783d-4670-9e50-4f90699a4ed7 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:30.900860 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-07178b2c-783d-4670-9e50-4f90699a4ed7 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e" status: 200 len: 1506 microversion: 2.1 time: 0.150609 Nov 24 15:23:30.901424 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 239/506] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:30 2021] GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:30.918196 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-276956b2-0512-4c5d-aef0-430eac3a678e tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "03c0766d-25f6-438d-bac3-091f58f7cb45", "device": "/dev/sdb"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:30.920129 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-276956b2-0512-4c5d-aef0-430eac3a678e tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:30.927287 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-276956b2-0512-4c5d-aef0-430eac3a678e tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:30.927727 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-276956b2-0512-4c5d-aef0-430eac3a678e tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:30.928524 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-276956b2-0512-4c5d-aef0-430eac3a678e tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:30.928954 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-276956b2-0512-4c5d-aef0-430eac3a678e tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:31.161790 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-276956b2-0512-4c5d-aef0-430eac3a678e tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "POST /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247617 Nov 24 15:23:31.162385 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 268/507] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Nov 24 15:23:30 2021] POST /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e/os-volume_attachments => generated 194 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:23:31.894114 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4935861c-f894-4f6d-b9a9-9868cfa4708a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:31.894954 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4935861c-f894-4f6d-b9a9-9868cfa4708a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:31.901364 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4935861c-f894-4f6d-b9a9-9868cfa4708a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:31.901807 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4935861c-f894-4f6d-b9a9-9868cfa4708a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:31.902588 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4935861c-f894-4f6d-b9a9-9868cfa4708a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:31.903057 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4935861c-f894-4f6d-b9a9-9868cfa4708a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:31.989475 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4935861c-f894-4f6d-b9a9-9868cfa4708a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 27804 microversion: 2.20 time: 0.098799 Nov 24 15:23:31.990377 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 240/508] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:31 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 27804 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:33.002975 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9f74b881-3198-4a57-b5e5-164a31fc7de2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:33.003962 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9f74b881-3198-4a57-b5e5-164a31fc7de2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:33.009950 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9f74b881-3198-4a57-b5e5-164a31fc7de2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:33.010392 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9f74b881-3198-4a57-b5e5-164a31fc7de2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:33.011194 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9f74b881-3198-4a57-b5e5-164a31fc7de2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:33.011624 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9f74b881-3198-4a57-b5e5-164a31fc7de2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:33.087959 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9f74b881-3198-4a57-b5e5-164a31fc7de2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 28214 microversion: 2.20 time: 0.090142 Nov 24 15:23:33.088598 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 269/509] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:32 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 28214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:34.099507 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-70297510-e76d-41f1-a572-c03b59e60832 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:34.100434 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-70297510-e76d-41f1-a572-c03b59e60832 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:34.107489 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-70297510-e76d-41f1-a572-c03b59e60832 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:34.107933 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-70297510-e76d-41f1-a572-c03b59e60832 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:34.108712 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-70297510-e76d-41f1-a572-c03b59e60832 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:34.109149 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-70297510-e76d-41f1-a572-c03b59e60832 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:34.174728 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-70297510-e76d-41f1-a572-c03b59e60832 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 28214 microversion: 2.20 time: 0.079331 Nov 24 15:23:34.175397 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 241/510] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:34 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 28214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:35.185980 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5ccc1d0b-a6c8-47f9-a37d-84b2e1951f06 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:35.186988 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5ccc1d0b-a6c8-47f9-a37d-84b2e1951f06 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:35.193798 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ccc1d0b-a6c8-47f9-a37d-84b2e1951f06 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:35.194240 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ccc1d0b-a6c8-47f9-a37d-84b2e1951f06 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:35.195035 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ccc1d0b-a6c8-47f9-a37d-84b2e1951f06 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:35.195463 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5ccc1d0b-a6c8-47f9-a37d-84b2e1951f06 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:35.276743 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5ccc1d0b-a6c8-47f9-a37d-84b2e1951f06 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 28505 microversion: 2.20 time: 0.094593 Nov 24 15:23:35.277416 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 270/511] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:35 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 28505 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 15:23:36.289536 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-9569e01f-6662-42ea-bf72-59bc4730cc7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:36.290559 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-9569e01f-6662-42ea-bf72-59bc4730cc7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:36.298007 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9569e01f-6662-42ea-bf72-59bc4730cc7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:36.298456 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9569e01f-6662-42ea-bf72-59bc4730cc7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:36.299273 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9569e01f-6662-42ea-bf72-59bc4730cc7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:36.299709 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9569e01f-6662-42ea-bf72-59bc4730cc7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:36.381873 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-9569e01f-6662-42ea-bf72-59bc4730cc7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 28673 microversion: 2.20 time: 0.096208 Nov 24 15:23:36.382417 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 242/512] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:36 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 28673 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:37.393852 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b74b0943-ed53-43e4-bdb5-a8b31af120a8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:37.394852 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b74b0943-ed53-43e4-bdb5-a8b31af120a8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:37.401666 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b74b0943-ed53-43e4-bdb5-a8b31af120a8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:37.402103 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b74b0943-ed53-43e4-bdb5-a8b31af120a8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:37.402892 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b74b0943-ed53-43e4-bdb5-a8b31af120a8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:37.403322 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b74b0943-ed53-43e4-bdb5-a8b31af120a8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:37.466391 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b74b0943-ed53-43e4-bdb5-a8b31af120a8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 28673 microversion: 2.20 time: 0.076451 Nov 24 15:23:37.467068 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 271/513] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:37 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 28673 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:38.478834 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4b05a6f9-8d40-4ff2-b510-f1bc3ee9aa00 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:38.479837 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4b05a6f9-8d40-4ff2-b510-f1bc3ee9aa00 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:38.487437 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4b05a6f9-8d40-4ff2-b510-f1bc3ee9aa00 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:38.487887 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4b05a6f9-8d40-4ff2-b510-f1bc3ee9aa00 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:38.488676 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4b05a6f9-8d40-4ff2-b510-f1bc3ee9aa00 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:38.489368 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4b05a6f9-8d40-4ff2-b510-f1bc3ee9aa00 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:38.558492 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4b05a6f9-8d40-4ff2-b510-f1bc3ee9aa00 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 28673 microversion: 2.20 time: 0.083556 Nov 24 15:23:38.559441 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 243/514] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:38 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 28673 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:39.571523 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5bce7f91-37be-4b9b-93bf-710cfafe06eb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:39.572450 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5bce7f91-37be-4b9b-93bf-710cfafe06eb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:39.579438 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5bce7f91-37be-4b9b-93bf-710cfafe06eb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:39.579885 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5bce7f91-37be-4b9b-93bf-710cfafe06eb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:39.580653 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5bce7f91-37be-4b9b-93bf-710cfafe06eb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:39.581088 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5bce7f91-37be-4b9b-93bf-710cfafe06eb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:42.053947 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5bce7f91-37be-4b9b-93bf-710cfafe06eb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 28673 microversion: 2.20 time: 2.486294 Nov 24 15:23:42.054576 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 272/515] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:39 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 28673 bytes in 2488 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:43.066551 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-24a94ab4-d1fd-4727-871c-3b152dc61164 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:43.067483 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-24a94ab4-d1fd-4727-871c-3b152dc61164 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:43.074316 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-24a94ab4-d1fd-4727-871c-3b152dc61164 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:43.074795 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-24a94ab4-d1fd-4727-871c-3b152dc61164 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:43.075596 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-24a94ab4-d1fd-4727-871c-3b152dc61164 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:43.076033 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-24a94ab4-d1fd-4727-871c-3b152dc61164 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:43.151516 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-24a94ab4-d1fd-4727-871c-3b152dc61164 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 28673 microversion: 2.20 time: 0.088905 Nov 24 15:23:43.152132 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 244/516] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:43 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 28673 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:44.163530 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e0f1bf06-61de-4dc3-9c8d-a810707b3d56 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:44.164556 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e0f1bf06-61de-4dc3-9c8d-a810707b3d56 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:44.172003 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0f1bf06-61de-4dc3-9c8d-a810707b3d56 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:44.172448 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0f1bf06-61de-4dc3-9c8d-a810707b3d56 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:44.173224 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0f1bf06-61de-4dc3-9c8d-a810707b3d56 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:44.173656 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0f1bf06-61de-4dc3-9c8d-a810707b3d56 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:46.001847 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e0f1bf06-61de-4dc3-9c8d-a810707b3d56 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 28673 microversion: 2.20 time: 1.842142 Nov 24 15:23:46.002780 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 273/517] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:44 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 28673 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:47.014498 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-549c9104-89c1-4525-96e8-b14fc0462ddf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:47.015452 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-549c9104-89c1-4525-96e8-b14fc0462ddf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:47.022295 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-549c9104-89c1-4525-96e8-b14fc0462ddf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:47.022744 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-549c9104-89c1-4525-96e8-b14fc0462ddf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:47.023544 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-549c9104-89c1-4525-96e8-b14fc0462ddf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:47.023979 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-549c9104-89c1-4525-96e8-b14fc0462ddf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:47.102458 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-549c9104-89c1-4525-96e8-b14fc0462ddf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 30072 microversion: 2.20 time: 0.092484 Nov 24 15:23:47.103861 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 245/518] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:47 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 30072 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:48.114932 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-77b04cbc-bbcb-4775-8ff5-cb8183fba4cd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:48.115966 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-77b04cbc-bbcb-4775-8ff5-cb8183fba4cd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:48.123451 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77b04cbc-bbcb-4775-8ff5-cb8183fba4cd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:48.123902 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77b04cbc-bbcb-4775-8ff5-cb8183fba4cd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:48.124675 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77b04cbc-bbcb-4775-8ff5-cb8183fba4cd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:48.125110 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77b04cbc-bbcb-4775-8ff5-cb8183fba4cd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:48.198223 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-77b04cbc-bbcb-4775-8ff5-cb8183fba4cd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 31756 microversion: 2.20 time: 0.088095 Nov 24 15:23:48.199572 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 274/519] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:48 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 31756 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:49.211643 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3cee4d79-5432-4413-bbe9-709f28a5fba9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:49.212862 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3cee4d79-5432-4413-bbe9-709f28a5fba9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:49.220261 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3cee4d79-5432-4413-bbe9-709f28a5fba9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:49.220707 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3cee4d79-5432-4413-bbe9-709f28a5fba9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:49.221482 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3cee4d79-5432-4413-bbe9-709f28a5fba9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:49.221915 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3cee4d79-5432-4413-bbe9-709f28a5fba9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:49.298298 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3cee4d79-5432-4413-bbe9-709f28a5fba9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 33245 microversion: 2.20 time: 0.090504 Nov 24 15:23:49.299816 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 246/520] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:49 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 33245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:50.310850 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-99a2e6f6-f517-4de9-abbc-b2753aef5078 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:50.312517 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-99a2e6f6-f517-4de9-abbc-b2753aef5078 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:50.319341 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99a2e6f6-f517-4de9-abbc-b2753aef5078 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:50.319788 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99a2e6f6-f517-4de9-abbc-b2753aef5078 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:50.320560 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99a2e6f6-f517-4de9-abbc-b2753aef5078 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:50.320993 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99a2e6f6-f517-4de9-abbc-b2753aef5078 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:50.374957 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-bb0027a3-a90d-458c-b1a4-74e170e7fc17 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:50.375534 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-bb0027a3-a90d-458c-b1a4-74e170e7fc17 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:50.382329 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bb0027a3-a90d-458c-b1a4-74e170e7fc17 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:50.382774 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bb0027a3-a90d-458c-b1a4-74e170e7fc17 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:50.383577 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bb0027a3-a90d-458c-b1a4-74e170e7fc17 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:50.384104 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bb0027a3-a90d-458c-b1a4-74e170e7fc17 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:50.395612 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-99a2e6f6-f517-4de9-abbc-b2753aef5078 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 34109 microversion: 2.20 time: 0.088665 Nov 24 15:23:50.399946 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 275/521] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:50 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 34109 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:50.465772 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-bb0027a3-a90d-458c-b1a4-74e170e7fc17 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lazy-loading 'services' on Instance uuid b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:23:50.543409 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-bb0027a3-a90d-458c-b1a4-74e170e7fc17 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e/os-volume_attachments/03c0766d-25f6-438d-bac3-091f58f7cb45" status: 202 len: 0 microversion: 2.1 time: 0.172535 Nov 24 15:23:50.544004 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 247/522] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Nov 24 15:23:50 2021] DELETE /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e/os-volume_attachments/03c0766d-25f6-438d-bac3-091f58f7cb45 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 15:23:51.408792 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c976523b-5489-4a14-ba79-44ae912c274f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:51.409780 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c976523b-5489-4a14-ba79-44ae912c274f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:51.416526 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c976523b-5489-4a14-ba79-44ae912c274f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:51.416972 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c976523b-5489-4a14-ba79-44ae912c274f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:51.417737 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c976523b-5489-4a14-ba79-44ae912c274f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:51.418170 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c976523b-5489-4a14-ba79-44ae912c274f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:51.487345 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c976523b-5489-4a14-ba79-44ae912c274f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 34969 microversion: 2.20 time: 0.083041 Nov 24 15:23:51.488243 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 276/523] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:51 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 34969 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:51.658042 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-fcb817f9-f353-420c-bfad-cc499052eb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:51.658614 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-fcb817f9-f353-420c-bfad-cc499052eb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:51.665039 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fcb817f9-f353-420c-bfad-cc499052eb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:51.665485 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fcb817f9-f353-420c-bfad-cc499052eb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:51.666263 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fcb817f9-f353-420c-bfad-cc499052eb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:51.666698 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fcb817f9-f353-420c-bfad-cc499052eb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:51.690100 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-fcb817f9-f353-420c-bfad-cc499052eb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Going to try to terminate instance {{(pid=116073) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:23:51.763812 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-fcb817f9-f353-420c-bfad-cc499052eb34 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e" status: 204 len: 0 microversion: 2.1 time: 0.110084 Nov 24 15:23:51.764397 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 248/524] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:23:51 2021] DELETE /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:23:51.773535 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4050f70c-3729-44ac-a6ae-10d02006f251 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:51.774217 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4050f70c-3729-44ac-a6ae-10d02006f251 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:51.781658 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4050f70c-3729-44ac-a6ae-10d02006f251 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:51.782102 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4050f70c-3729-44ac-a6ae-10d02006f251 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:51.782891 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4050f70c-3729-44ac-a6ae-10d02006f251 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:51.783320 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4050f70c-3729-44ac-a6ae-10d02006f251 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:51.915505 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4050f70c-3729-44ac-a6ae-10d02006f251 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:51.922757 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4050f70c-3729-44ac-a6ae-10d02006f251 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e" status: 200 len: 1512 microversion: 2.1 time: 0.153383 Nov 24 15:23:51.923382 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 277/525] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:51 2021] GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:52.501015 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-585bb24c-e8d7-4361-a3f5-926399fe8626 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:52.502013 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-585bb24c-e8d7-4361-a3f5-926399fe8626 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:52.508291 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-585bb24c-e8d7-4361-a3f5-926399fe8626 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:52.508740 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-585bb24c-e8d7-4361-a3f5-926399fe8626 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:52.509508 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-585bb24c-e8d7-4361-a3f5-926399fe8626 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:52.509938 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-585bb24c-e8d7-4361-a3f5-926399fe8626 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:52.582217 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-585bb24c-e8d7-4361-a3f5-926399fe8626 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 35855 microversion: 2.20 time: 0.085774 Nov 24 15:23:52.582761 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 249/526] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:52 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 35855 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:52.940519 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f883af82-8ee3-4db1-8a1e-cc703703527a tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:52.941031 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f883af82-8ee3-4db1-8a1e-cc703703527a tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:52.947438 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f883af82-8ee3-4db1-8a1e-cc703703527a tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:52.947887 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f883af82-8ee3-4db1-8a1e-cc703703527a tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:52.948657 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f883af82-8ee3-4db1-8a1e-cc703703527a tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:52.949087 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f883af82-8ee3-4db1-8a1e-cc703703527a tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:53.079841 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f883af82-8ee3-4db1-8a1e-cc703703527a tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:53.087477 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f883af82-8ee3-4db1-8a1e-cc703703527a tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e" status: 200 len: 1512 microversion: 2.1 time: 0.151089 Nov 24 15:23:53.088056 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 278/527] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:52 2021] GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:23:53.594727 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-78f980b0-d72a-4310-b092-65d7048bb643 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:53.595825 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-78f980b0-d72a-4310-b092-65d7048bb643 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:53.602474 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-78f980b0-d72a-4310-b092-65d7048bb643 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:53.602942 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-78f980b0-d72a-4310-b092-65d7048bb643 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:53.603794 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-78f980b0-d72a-4310-b092-65d7048bb643 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:53.604226 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-78f980b0-d72a-4310-b092-65d7048bb643 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:53.676356 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-78f980b0-d72a-4310-b092-65d7048bb643 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 36970 microversion: 2.20 time: 0.086164 Nov 24 15:23:53.677278 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 250/528] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:53 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 36970 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:54.013007 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-d04dcfbc-5885-4df3-a6de-d8a7369c1dfa req-857a7c28-2166-42cf-b158-7b1eacb33d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e", "name": "network-vif-deleted", "tag": "0de4531c-4f51-49ee-94c1-761f6aeffde1"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:54.015032 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:23:54.015032 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:23:54.022528 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-d04dcfbc-5885-4df3-a6de-d8a7369c1dfa req-857a7c28-2166-42cf-b158-7b1eacb33d8a service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:54.023062 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-d04dcfbc-5885-4df3-a6de-d8a7369c1dfa req-857a7c28-2166-42cf-b158-7b1eacb33d8a service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:54.035108 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-d04dcfbc-5885-4df3-a6de-d8a7369c1dfa req-857a7c28-2166-42cf-b158-7b1eacb33d8a service nova] Creating event network-vif-deleted:0de4531c-4f51-49ee-94c1-761f6aeffde1 for instance b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e on hv-cinder-80403 Nov 24 15:23:54.041361 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-d04dcfbc-5885-4df3-a6de-d8a7369c1dfa req-857a7c28-2166-42cf-b158-7b1eacb33d8a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032043 Nov 24 15:23:54.041942 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 279/529] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:23:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:23:54.104977 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-829187d4-5f61-4c0d-99b0-c03146a4fa01 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:54.105850 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-829187d4-5f61-4c0d-99b0-c03146a4fa01 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:54.114107 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-829187d4-5f61-4c0d-99b0-c03146a4fa01 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:54.114433 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-829187d4-5f61-4c0d-99b0-c03146a4fa01 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:54.115576 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-829187d4-5f61-4c0d-99b0-c03146a4fa01 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:54.116007 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-829187d4-5f61-4c0d-99b0-c03146a4fa01 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:54.148319 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-829187d4-5f61-4c0d-99b0-c03146a4fa01 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:54.148793 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-829187d4-5f61-4c0d-99b0-c03146a4fa01 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:54.149238 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-829187d4-5f61-4c0d-99b0-c03146a4fa01 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lazy-loading 'fault' on Instance uuid b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:23:54.188973 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-829187d4-5f61-4c0d-99b0-c03146a4fa01 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c4128eac441411e9114acc0b6395f17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '043d05ede00543d285fddc5f601117c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:23:54.196231 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-829187d4-5f61-4c0d-99b0-c03146a4fa01 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e" status: 200 len: 1308 microversion: 2.1 time: 0.095831 Nov 24 15:23:54.196800 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 251/530] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:54 2021] GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:23:54.689393 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a978114a-43a3-4a6f-90af-3df9fcb34fe9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:54.690727 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a978114a-43a3-4a6f-90af-3df9fcb34fe9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:54.697636 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a978114a-43a3-4a6f-90af-3df9fcb34fe9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:54.698055 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a978114a-43a3-4a6f-90af-3df9fcb34fe9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:54.698874 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a978114a-43a3-4a6f-90af-3df9fcb34fe9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:54.699320 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a978114a-43a3-4a6f-90af-3df9fcb34fe9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:54.774581 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a978114a-43a3-4a6f-90af-3df9fcb34fe9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 38222 microversion: 2.20 time: 0.089648 Nov 24 15:23:54.775285 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 280/531] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:54 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 38222 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:55.214357 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-88727ac7-0385-4cf0-8764-96a1145504e8 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:55.214986 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-88727ac7-0385-4cf0-8764-96a1145504e8 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] [instance: b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:55.221880 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-88727ac7-0385-4cf0-8764-96a1145504e8 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:55.222319 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-88727ac7-0385-4cf0-8764-96a1145504e8 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:55.223115 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-88727ac7-0385-4cf0-8764-96a1145504e8 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:55.223549 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-88727ac7-0385-4cf0-8764-96a1145504e8 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:55.236265 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-88727ac7-0385-4cf0-8764-96a1145504e8 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] HTTP exception thrown: Instance b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e could not be found. Nov 24 15:23:55.236830 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-88727ac7-0385-4cf0-8764-96a1145504e8 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] Returning 404 to user: Instance b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:23:55.237619 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-88727ac7-0385-4cf0-8764-96a1145504e8 tempest-VolumesSnapshotTestJSON-1505827673 tempest-VolumesSnapshotTestJSON-1505827673-project] 10.222.0.66 "GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e" status: 404 len: 111 microversion: 2.1 time: 0.027066 Nov 24 15:23:55.238133 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 252/532] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:23:55 2021] GET /compute/v2.1/servers/b80f6801-ee92-4d6b-9fa8-a6ecd1c77f1e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:23:55.787130 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-eafa8b86-690a-4106-9501-fecff701e504 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:55.788141 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-eafa8b86-690a-4106-9501-fecff701e504 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:55.794897 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eafa8b86-690a-4106-9501-fecff701e504 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:55.795341 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eafa8b86-690a-4106-9501-fecff701e504 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:55.796114 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eafa8b86-690a-4106-9501-fecff701e504 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:55.796537 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eafa8b86-690a-4106-9501-fecff701e504 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:55.858409 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-eafa8b86-690a-4106-9501-fecff701e504 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 38222 microversion: 2.20 time: 0.075351 Nov 24 15:23:55.859039 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 281/533] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:55 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 38222 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:23:56.869873 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a74e6769-8493-447c-bf71-0e1ef28b431b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:23:56.870691 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a74e6769-8493-447c-bf71-0e1ef28b431b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:56.876978 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a74e6769-8493-447c-bf71-0e1ef28b431b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:56.877422 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a74e6769-8493-447c-bf71-0e1ef28b431b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:56.878194 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a74e6769-8493-447c-bf71-0e1ef28b431b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:56.878626 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a74e6769-8493-447c-bf71-0e1ef28b431b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:59.737963 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a74e6769-8493-447c-bf71-0e1ef28b431b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 200 len: 38363 microversion: 2.20 time: 2.870259 Nov 24 15:23:59.737963 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 253/534] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:23:56 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 38363 bytes in 2872 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 15:23:59.747886 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f88e7e3f-283b-426f-b86f-e715a77b1a99 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:59.748479 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f88e7e3f-283b-426f-b86f-e715a77b1a99 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:59.756103 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f88e7e3f-283b-426f-b86f-e715a77b1a99 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:59.756550 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f88e7e3f-283b-426f-b86f-e715a77b1a99 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:59.757347 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f88e7e3f-283b-426f-b86f-e715a77b1a99 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:59.757783 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f88e7e3f-283b-426f-b86f-e715a77b1a99 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:59.783139 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f88e7e3f-283b-426f-b86f-e715a77b1a99 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/ips" status: 200 len: 151 microversion: 2.20 time: 0.039142 Nov 24 15:23:59.783727 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 282/535] 10.222.0.66 () {60 vars in 1288 bytes} [Wed Nov 24 15:23:59 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:23:59.958935 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f05258c1-f703-4d08-ad16-106a4d0b92e1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:23:59.959934 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-f05258c1-f703-4d08-ad16-106a4d0b92e1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:23:59.966934 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f05258c1-f703-4d08-ad16-106a4d0b92e1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:59.967474 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f05258c1-f703-4d08-ad16-106a4d0b92e1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:59.968322 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f05258c1-f703-4d08-ad16-106a4d0b92e1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:23:59.968933 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f05258c1-f703-4d08-ad16-106a4d0b92e1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:23:59.999275 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f05258c1-f703-4d08-ad16-106a4d0b92e1 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044374 Nov 24 15:23:59.999836 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 254/536] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:23:59 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:24:00.059363 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2a446ae0-b86b-42df-a757-ac5d73112124 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:00.059930 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2a446ae0-b86b-42df-a757-ac5d73112124 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:00.067093 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2a446ae0-b86b-42df-a757-ac5d73112124 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:00.067468 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2a446ae0-b86b-42df-a757-ac5d73112124 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:00.068191 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2a446ae0-b86b-42df-a757-ac5d73112124 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:00.068620 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2a446ae0-b86b-42df-a757-ac5d73112124 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:00.095614 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2a446ae0-b86b-42df-a757-ac5d73112124 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:24:00.176399 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2a446ae0-b86b-42df-a757-ac5d73112124 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "DELETE /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 204 len: 0 microversion: 2.1 time: 0.120517 Nov 24 15:24:00.177379 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 283/537] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:24:00 2021] DELETE /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:24:00.185868 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a5f0189f-5706-4bd0-888d-09b5f05d71e4 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:00.186561 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a5f0189f-5706-4bd0-888d-09b5f05d71e4 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:00.193058 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a5f0189f-5706-4bd0-888d-09b5f05d71e4 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:00.193506 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a5f0189f-5706-4bd0-888d-09b5f05d71e4 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:00.194288 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a5f0189f-5706-4bd0-888d-09b5f05d71e4 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:00.194728 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a5f0189f-5706-4bd0-888d-09b5f05d71e4 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:00.330474 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-a5f0189f-5706-4bd0-888d-09b5f05d71e4 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:00.337723 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a5f0189f-5706-4bd0-888d-09b5f05d71e4 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1671 microversion: 2.1 time: 0.155549 Nov 24 15:24:00.338278 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 255/538] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:00 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:24:01.355973 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d9c4a0d0-7285-4f7d-bee1-d25f7c5e6b78 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:01.356635 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d9c4a0d0-7285-4f7d-bee1-d25f7c5e6b78 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:01.362844 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9c4a0d0-7285-4f7d-bee1-d25f7c5e6b78 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:01.363301 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9c4a0d0-7285-4f7d-bee1-d25f7c5e6b78 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:01.364343 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9c4a0d0-7285-4f7d-bee1-d25f7c5e6b78 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:01.364805 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9c4a0d0-7285-4f7d-bee1-d25f7c5e6b78 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:01.497199 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d9c4a0d0-7285-4f7d-bee1-d25f7c5e6b78 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:01.504537 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d9c4a0d0-7285-4f7d-bee1-d25f7c5e6b78 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1671 microversion: 2.1 time: 0.152622 Nov 24 15:24:01.505097 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 284/539] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:01 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:01.896788 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8f161a82-9f83-4bde-8914-bfa1915c0b5a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:01.897361 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8f161a82-9f83-4bde-8914-bfa1915c0b5a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:01.903647 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f161a82-9f83-4bde-8914-bfa1915c0b5a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:01.904097 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f161a82-9f83-4bde-8914-bfa1915c0b5a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:01.904876 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f161a82-9f83-4bde-8914-bfa1915c0b5a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:01.905314 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f161a82-9f83-4bde-8914-bfa1915c0b5a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:01.928140 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-8f161a82-9f83-4bde-8914-bfa1915c0b5a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lazy-loading 'flavor' on Instance uuid 361e1e6c-853b-4fde-89ed-843a85be79c1 {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:24:02.219565 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8f161a82-9f83-4bde-8914-bfa1915c0b5a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 202 len: 0 microversion: 2.20 time: 0.325951 Nov 24 15:24:02.223349 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 256/540] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:24:01 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:24:02.233638 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5058d14d-8918-4f47-885c-93ee382027b4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:02.234867 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5058d14d-8918-4f47-885c-93ee382027b4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:02.242111 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5058d14d-8918-4f47-885c-93ee382027b4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:02.243101 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5058d14d-8918-4f47-885c-93ee382027b4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:02.245951 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5058d14d-8918-4f47-885c-93ee382027b4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:02.246576 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5058d14d-8918-4f47-885c-93ee382027b4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:02.389209 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5058d14d-8918-4f47-885c-93ee382027b4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:02.397736 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5058d14d-8918-4f47-885c-93ee382027b4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:02.399657 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5058d14d-8918-4f47-885c-93ee382027b4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:02.400893 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5058d14d-8918-4f47-885c-93ee382027b4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1722 microversion: 2.20 time: 0.171964 Nov 24 15:24:02.401532 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 285/541] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:02 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:02.523321 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-9060735d-cc8d-49a1-aded-044fd009f8a5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:02.524021 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-9060735d-cc8d-49a1-aded-044fd009f8a5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:02.530422 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9060735d-cc8d-49a1-aded-044fd009f8a5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:02.530920 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9060735d-cc8d-49a1-aded-044fd009f8a5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:02.531712 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9060735d-cc8d-49a1-aded-044fd009f8a5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:02.532152 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9060735d-cc8d-49a1-aded-044fd009f8a5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:02.663005 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-9060735d-cc8d-49a1-aded-044fd009f8a5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:02.670703 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-9060735d-cc8d-49a1-aded-044fd009f8a5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 200 len: 1671 microversion: 2.1 time: 0.151636 Nov 24 15:24:02.671303 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 257/542] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:02 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:03.151438 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-0f91cee1-0615-4e1d-bc48-507c8552060b req-cf0a5f42-4edf-44f9-a054-05016a17b621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60818665-e1d1-4651-9b32-94b226a506c9", "name": "network-vif-deleted", "tag": "f913887e-e2c7-4f41-9773-44b6265eb1f9"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:03.157430 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:24:03.157430 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:24:03.167393 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-0f91cee1-0615-4e1d-bc48-507c8552060b req-cf0a5f42-4edf-44f9-a054-05016a17b621 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:03.167931 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-0f91cee1-0615-4e1d-bc48-507c8552060b req-cf0a5f42-4edf-44f9-a054-05016a17b621 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:03.180192 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-0f91cee1-0615-4e1d-bc48-507c8552060b req-cf0a5f42-4edf-44f9-a054-05016a17b621 service nova] Creating event network-vif-deleted:f913887e-e2c7-4f41-9773-44b6265eb1f9 for instance 60818665-e1d1-4651-9b32-94b226a506c9 on hv-cinder-80403 Nov 24 15:24:03.187442 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-0f91cee1-0615-4e1d-bc48-507c8552060b req-cf0a5f42-4edf-44f9-a054-05016a17b621 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042843 Nov 24 15:24:03.188923 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 286/543] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:24:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:24:03.419157 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-e79266a2-beac-4125-bce4-5e99b83ed1c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:03.419773 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-e79266a2-beac-4125-bce4-5e99b83ed1c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:03.427153 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e79266a2-beac-4125-bce4-5e99b83ed1c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:03.427843 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e79266a2-beac-4125-bce4-5e99b83ed1c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:03.428890 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e79266a2-beac-4125-bce4-5e99b83ed1c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:03.429418 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e79266a2-beac-4125-bce4-5e99b83ed1c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:03.634268 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e79266a2-beac-4125-bce4-5e99b83ed1c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:03.647379 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e79266a2-beac-4125-bce4-5e99b83ed1c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:03.649070 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e79266a2-beac-4125-bce4-5e99b83ed1c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:03.650891 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-e79266a2-beac-4125-bce4-5e99b83ed1c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1722 microversion: 2.20 time: 0.235423 Nov 24 15:24:03.651935 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 258/544] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:03 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:03.690448 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a15b482f-b3e6-47ff-8da3-951e97046646 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:03.691916 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a15b482f-b3e6-47ff-8da3-951e97046646 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:03.706086 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a15b482f-b3e6-47ff-8da3-951e97046646 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:03.707473 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a15b482f-b3e6-47ff-8da3-951e97046646 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:03.712635 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a15b482f-b3e6-47ff-8da3-951e97046646 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:03.713468 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a15b482f-b3e6-47ff-8da3-951e97046646 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:03.733382 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-a15b482f-b3e6-47ff-8da3-951e97046646 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] HTTP exception thrown: Instance 60818665-e1d1-4651-9b32-94b226a506c9 could not be found. Nov 24 15:24:03.733988 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a15b482f-b3e6-47ff-8da3-951e97046646 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Returning 404 to user: Instance 60818665-e1d1-4651-9b32-94b226a506c9 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:24:03.735043 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a15b482f-b3e6-47ff-8da3-951e97046646 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 404 len: 111 microversion: 2.1 time: 0.050197 Nov 24 15:24:03.735604 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 287/545] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:03 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:24:03.744227 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b76bd806-ab8a-43e2-98f4-036e09fdbaff tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '.version_select at 0x7f930d64dd30>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:03.791853 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b76bd806-ab8a-43e2-98f4-036e09fdbaff tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-482992359" status: 202 len: 0 microversion: 2.1 time: 0.050410 Nov 24 15:24:03.795195 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 259/546] 10.222.0.66 () {58 vars in 1217 bytes} [Wed Nov 24 15:24:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-482992359 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:24:04.470160 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6621b6a3-8156-4380-93e2-376f52332791 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'create', calling method: .version_select at 0x7f930cc16d30>, body: {"keypair": {"name": "tempest-keypair-1320683131"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:04.486235 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-6621b6a3-8156-4380-93e2-376f52332791 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Getting quotas for project cebad9fcbd0d4232a6f6dccb42ba04a1. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:24:04.490725 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-6621b6a3-8156-4380-93e2-376f52332791 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Getting quotas for user a43cdd892899464190fa5a6cfc411ad0 and project cebad9fcbd0d4232a6f6dccb42ba04a1. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:24:04.642723 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-6621b6a3-8156-4380-93e2-376f52332791 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Getting quotas for project cebad9fcbd0d4232a6f6dccb42ba04a1. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:24:04.646626 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-6621b6a3-8156-4380-93e2-376f52332791 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Getting quotas for user a43cdd892899464190fa5a6cfc411ad0 and project cebad9fcbd0d4232a6f6dccb42ba04a1. Resources: {'key_pairs'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:24:04.661262 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6621b6a3-8156-4380-93e2-376f52332791 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.194825 Nov 24 15:24:04.662245 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 288/547] 10.222.0.66 () {60 vars in 1157 bytes} [Wed Nov 24 15:24:04 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:04.669361 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-7ff92ee2-8f5c-4998-95d0-27aaf8dab83b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:04.670221 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-7ff92ee2-8f5c-4998-95d0-27aaf8dab83b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:04.685901 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7ff92ee2-8f5c-4998-95d0-27aaf8dab83b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:04.686548 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7ff92ee2-8f5c-4998-95d0-27aaf8dab83b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:04.688215 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7ff92ee2-8f5c-4998-95d0-27aaf8dab83b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:04.688823 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7ff92ee2-8f5c-4998-95d0-27aaf8dab83b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:04.890185 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-7ff92ee2-8f5c-4998-95d0-27aaf8dab83b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:04.903399 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-7ff92ee2-8f5c-4998-95d0-27aaf8dab83b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:04.905013 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-7ff92ee2-8f5c-4998-95d0-27aaf8dab83b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:04.906960 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-7ff92ee2-8f5c-4998-95d0-27aaf8dab83b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1722 microversion: 2.20 time: 0.240739 Nov 24 15:24:04.907746 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 260/548] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:04 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:05.926060 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f2efeddd-8619-435f-873a-f1cb008a5d94 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:05.927081 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f2efeddd-8619-435f-873a-f1cb008a5d94 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:05.933782 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f2efeddd-8619-435f-873a-f1cb008a5d94 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:05.934232 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f2efeddd-8619-435f-873a-f1cb008a5d94 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:05.935042 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f2efeddd-8619-435f-873a-f1cb008a5d94 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:05.935472 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f2efeddd-8619-435f-873a-f1cb008a5d94 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:06.001894 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-332738989", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a227d49c-a3bd-45ee-b0d2-bcce569a4266"}], "security_groups": [{"name": "tempest-securitygroup--297277228"}], "key_name": "tempest-keypair-1320683131", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:06.086670 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f2efeddd-8619-435f-873a-f1cb008a5d94 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:06.095564 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f2efeddd-8619-435f-873a-f1cb008a5d94 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:06.097165 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f2efeddd-8619-435f-873a-f1cb008a5d94 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:06.098420 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f2efeddd-8619-435f-873a-f1cb008a5d94 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1722 microversion: 2.20 time: 0.177006 Nov 24 15:24:06.099081 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 289/549] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:05 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:06.116732 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.network.neutron [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] validate_networks() for [('a227d49c-a3bd-45ee-b0d2-bcce569a4266', None, None, None, None, None)] {{(pid=116073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:24:06.471761 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Flavor limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:24:06.472178 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Image limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:24:06.472648 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Flavor pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:24:06.473163 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Image pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:24:06.473572 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:24:06.482099 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:06.482538 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:06.483390 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:06.483818 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:06.499889 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Getting quotas for project cebad9fcbd0d4232a6f6dccb42ba04a1. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:24:06.503765 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Getting quotas for user a43cdd892899464190fa5a6cfc411ad0 and project cebad9fcbd0d4232a6f6dccb42ba04a1. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:24:06.514308 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Going to run 1 instances... {{(pid=116073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:24:06.517128 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:24:06.563223 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c41400d1-e8c9-45fa-b991-8fd98dcc4d9c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.565860 Nov 24 15:24:06.564126 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 261/550] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:24:05 2021] POST /compute/v2.1/servers => generated 401 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 15:24:06.573636 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-05011404-0c2c-4de7-afb4-7d9dcfd25530 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:06.574245 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-05011404-0c2c-4de7-afb4-7d9dcfd25530 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:06.627504 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-05011404-0c2c-4de7-afb4-7d9dcfd25530 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:06.634079 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-05011404-0c2c-4de7-afb4-7d9dcfd25530 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 200 len: 1237 microversion: 2.1 time: 0.063892 Nov 24 15:24:06.634639 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 290/551] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:06 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 1237 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:07.117390 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-bcfc1602-3c70-4152-a264-b98e53c7e2c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:07.118343 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-bcfc1602-3c70-4152-a264-b98e53c7e2c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:07.125191 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bcfc1602-3c70-4152-a264-b98e53c7e2c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:07.125636 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bcfc1602-3c70-4152-a264-b98e53c7e2c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:07.126405 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bcfc1602-3c70-4152-a264-b98e53c7e2c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:07.126855 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bcfc1602-3c70-4152-a264-b98e53c7e2c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:07.261559 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-bcfc1602-3c70-4152-a264-b98e53c7e2c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:07.269395 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-bcfc1602-3c70-4152-a264-b98e53c7e2c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:07.270918 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-bcfc1602-3c70-4152-a264-b98e53c7e2c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:07.272071 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-bcfc1602-3c70-4152-a264-b98e53c7e2c8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1722 microversion: 2.20 time: 0.159184 Nov 24 15:24:07.272625 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 262/552] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:07 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:07.651194 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-998452fe-8c20-4ad8-867f-d8fc119c1229 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:07.651876 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-998452fe-8c20-4ad8-867f-d8fc119c1229 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:07.658923 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-998452fe-8c20-4ad8-867f-d8fc119c1229 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:07.659370 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-998452fe-8c20-4ad8-867f-d8fc119c1229 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:07.660138 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-998452fe-8c20-4ad8-867f-d8fc119c1229 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:07.660569 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-998452fe-8c20-4ad8-867f-d8fc119c1229 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:07.719805 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-998452fe-8c20-4ad8-867f-d8fc119c1229 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:07.727046 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-998452fe-8c20-4ad8-867f-d8fc119c1229 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 200 len: 1241 microversion: 2.1 time: 0.079473 Nov 24 15:24:07.727612 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 291/553] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:07 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:08.289261 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ebfaf5bf-035b-426c-9483-423832ee76cf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:08.289858 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ebfaf5bf-035b-426c-9483-423832ee76cf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:08.296145 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebfaf5bf-035b-426c-9483-423832ee76cf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:08.296630 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebfaf5bf-035b-426c-9483-423832ee76cf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:08.297487 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebfaf5bf-035b-426c-9483-423832ee76cf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:08.298032 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebfaf5bf-035b-426c-9483-423832ee76cf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:08.425538 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ebfaf5bf-035b-426c-9483-423832ee76cf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:08.433302 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ebfaf5bf-035b-426c-9483-423832ee76cf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:08.434780 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ebfaf5bf-035b-426c-9483-423832ee76cf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:08.435945 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ebfaf5bf-035b-426c-9483-423832ee76cf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1722 microversion: 2.20 time: 0.150404 Nov 24 15:24:08.436488 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 263/554] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:08 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:08.744362 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-43b31078-bfdc-4aa3-9e12-00bf678a9e13 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:08.744989 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-43b31078-bfdc-4aa3-9e12-00bf678a9e13 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:08.751820 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-43b31078-bfdc-4aa3-9e12-00bf678a9e13 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:08.752264 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-43b31078-bfdc-4aa3-9e12-00bf678a9e13 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:08.753039 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-43b31078-bfdc-4aa3-9e12-00bf678a9e13 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:08.753470 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-43b31078-bfdc-4aa3-9e12-00bf678a9e13 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:08.811511 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-43b31078-bfdc-4aa3-9e12-00bf678a9e13 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:08.819117 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-43b31078-bfdc-4aa3-9e12-00bf678a9e13 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 200 len: 1295 microversion: 2.1 time: 0.078357 Nov 24 15:24:08.819673 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 292/555] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:08 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 1295 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:09.455184 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-e85acf1b-20d2-474c-ada4-dfb6bfe6cb2a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:09.455760 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-e85acf1b-20d2-474c-ada4-dfb6bfe6cb2a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:09.462077 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e85acf1b-20d2-474c-ada4-dfb6bfe6cb2a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:09.462534 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e85acf1b-20d2-474c-ada4-dfb6bfe6cb2a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:09.463358 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e85acf1b-20d2-474c-ada4-dfb6bfe6cb2a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:09.463798 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e85acf1b-20d2-474c-ada4-dfb6bfe6cb2a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:09.600389 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e85acf1b-20d2-474c-ada4-dfb6bfe6cb2a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:09.608805 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e85acf1b-20d2-474c-ada4-dfb6bfe6cb2a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:09.610608 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e85acf1b-20d2-474c-ada4-dfb6bfe6cb2a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:09.611905 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-e85acf1b-20d2-474c-ada4-dfb6bfe6cb2a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1722 microversion: 2.20 time: 0.161030 Nov 24 15:24:09.612495 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 264/556] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:09 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:09.837622 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-238d6eb5-69b6-44df-8d7e-4a8cfcdf5897 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:09.839379 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-238d6eb5-69b6-44df-8d7e-4a8cfcdf5897 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:09.846785 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-238d6eb5-69b6-44df-8d7e-4a8cfcdf5897 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:09.847275 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-238d6eb5-69b6-44df-8d7e-4a8cfcdf5897 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:09.848077 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-238d6eb5-69b6-44df-8d7e-4a8cfcdf5897 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:09.848521 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-238d6eb5-69b6-44df-8d7e-4a8cfcdf5897 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:09.916893 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-2ed2807a-d457-47d7-a6f2-4aaca4000e91 req-f74f987f-8502-4f0e-bb9e-2e8f87be84c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e", "tag": "a9ea99c7-9e9a-429a-a735-dcc12c181098"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:09.918435 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:24:09.918435 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:24:09.925838 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-2ed2807a-d457-47d7-a6f2-4aaca4000e91 req-f74f987f-8502-4f0e-bb9e-2e8f87be84c2 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:09.926975 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-2ed2807a-d457-47d7-a6f2-4aaca4000e91 req-f74f987f-8502-4f0e-bb9e-2e8f87be84c2 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:09.947449 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-2ed2807a-d457-47d7-a6f2-4aaca4000e91 req-f74f987f-8502-4f0e-bb9e-2e8f87be84c2 service nova] Creating event network-changed:a9ea99c7-9e9a-429a-a735-dcc12c181098 for instance b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e on hv-cinder-80403 Nov 24 15:24:09.956212 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-2ed2807a-d457-47d7-a6f2-4aaca4000e91 req-f74f987f-8502-4f0e-bb9e-2e8f87be84c2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042959 Nov 24 15:24:09.957158 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 265/557] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:24:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:24:10.016697 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-238d6eb5-69b6-44df-8d7e-4a8cfcdf5897 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:10.024585 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-238d6eb5-69b6-44df-8d7e-4a8cfcdf5897 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 200 len: 1362 microversion: 2.1 time: 0.191928 Nov 24 15:24:10.025491 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 293/558] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:09 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:10.631134 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-eac10e4e-d2e7-40bf-8baf-1fa1a8598fa9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:10.631892 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-eac10e4e-d2e7-40bf-8baf-1fa1a8598fa9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:10.638697 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eac10e4e-d2e7-40bf-8baf-1fa1a8598fa9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:10.639209 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eac10e4e-d2e7-40bf-8baf-1fa1a8598fa9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:10.639955 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eac10e4e-d2e7-40bf-8baf-1fa1a8598fa9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:10.641163 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eac10e4e-d2e7-40bf-8baf-1fa1a8598fa9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:10.779745 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-eac10e4e-d2e7-40bf-8baf-1fa1a8598fa9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:10.788084 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-eac10e4e-d2e7-40bf-8baf-1fa1a8598fa9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:10.789683 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-eac10e4e-d2e7-40bf-8baf-1fa1a8598fa9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:10.790999 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-eac10e4e-d2e7-40bf-8baf-1fa1a8598fa9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1722 microversion: 2.20 time: 0.164704 Nov 24 15:24:10.791650 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 266/559] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:10 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:11.041228 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8d970863-fc4e-49a4-9ffa-58aef7ebfa3b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:11.041798 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8d970863-fc4e-49a4-9ffa-58aef7ebfa3b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:11.048645 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d970863-fc4e-49a4-9ffa-58aef7ebfa3b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:11.049088 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d970863-fc4e-49a4-9ffa-58aef7ebfa3b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:11.049859 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d970863-fc4e-49a4-9ffa-58aef7ebfa3b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:11.050291 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d970863-fc4e-49a4-9ffa-58aef7ebfa3b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:11.176628 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8d970863-fc4e-49a4-9ffa-58aef7ebfa3b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:11.183839 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8d970863-fc4e-49a4-9ffa-58aef7ebfa3b tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 200 len: 1362 microversion: 2.1 time: 0.146343 Nov 24 15:24:11.184401 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 294/560] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:11 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:11.809291 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-e721b2f4-97f3-4c51-91e5-1d3cfc3adeb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:11.809831 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-e721b2f4-97f3-4c51-91e5-1d3cfc3adeb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:11.816080 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e721b2f4-97f3-4c51-91e5-1d3cfc3adeb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:11.816533 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e721b2f4-97f3-4c51-91e5-1d3cfc3adeb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:11.817309 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e721b2f4-97f3-4c51-91e5-1d3cfc3adeb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:11.817746 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e721b2f4-97f3-4c51-91e5-1d3cfc3adeb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:11.944754 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e721b2f4-97f3-4c51-91e5-1d3cfc3adeb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:11.952460 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e721b2f4-97f3-4c51-91e5-1d3cfc3adeb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:11.954449 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e721b2f4-97f3-4c51-91e5-1d3cfc3adeb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:11.955615 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-e721b2f4-97f3-4c51-91e5-1d3cfc3adeb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1722 microversion: 2.20 time: 0.150113 Nov 24 15:24:11.956172 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 267/561] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:11 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:12.200635 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-86717ec7-1b90-4a8e-b3e7-c95eeeecc234 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:12.201272 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-86717ec7-1b90-4a8e-b3e7-c95eeeecc234 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:12.208144 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-86717ec7-1b90-4a8e-b3e7-c95eeeecc234 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:12.208591 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-86717ec7-1b90-4a8e-b3e7-c95eeeecc234 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:12.209369 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-86717ec7-1b90-4a8e-b3e7-c95eeeecc234 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:12.209806 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-86717ec7-1b90-4a8e-b3e7-c95eeeecc234 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:12.341169 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-86717ec7-1b90-4a8e-b3e7-c95eeeecc234 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:12.348437 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-86717ec7-1b90-4a8e-b3e7-c95eeeecc234 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 200 len: 1362 microversion: 2.1 time: 0.151498 Nov 24 15:24:12.349009 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 295/562] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:12 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:12.973771 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f68c1227-650a-424d-922c-5eb2d1a1a98c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:12.974371 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-f68c1227-650a-424d-922c-5eb2d1a1a98c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:12.980779 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f68c1227-650a-424d-922c-5eb2d1a1a98c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:12.981221 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f68c1227-650a-424d-922c-5eb2d1a1a98c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:12.981984 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f68c1227-650a-424d-922c-5eb2d1a1a98c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:12.982416 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f68c1227-650a-424d-922c-5eb2d1a1a98c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:13.111683 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-f68c1227-650a-424d-922c-5eb2d1a1a98c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:13.119577 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-f68c1227-650a-424d-922c-5eb2d1a1a98c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:13.121059 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-f68c1227-650a-424d-922c-5eb2d1a1a98c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:13.122229 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f68c1227-650a-424d-922c-5eb2d1a1a98c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1722 microversion: 2.20 time: 0.152203 Nov 24 15:24:13.122775 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 268/563] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:12 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:13.365384 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cafd2856-07c2-4655-9bc4-0d0c61797f8e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:13.366025 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cafd2856-07c2-4655-9bc4-0d0c61797f8e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:13.372298 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cafd2856-07c2-4655-9bc4-0d0c61797f8e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:13.372745 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cafd2856-07c2-4655-9bc4-0d0c61797f8e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:13.373521 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cafd2856-07c2-4655-9bc4-0d0c61797f8e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:13.373955 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cafd2856-07c2-4655-9bc4-0d0c61797f8e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:13.706873 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cafd2856-07c2-4655-9bc4-0d0c61797f8e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:13.714070 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cafd2856-07c2-4655-9bc4-0d0c61797f8e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 200 len: 1362 microversion: 2.1 time: 0.352597 Nov 24 15:24:13.714672 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 296/564] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:13 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:14.140427 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-62a96a2f-b2cf-4c0e-ba20-b3f0e65beae7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:14.141613 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-62a96a2f-b2cf-4c0e-ba20-b3f0e65beae7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:14.147758 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-62a96a2f-b2cf-4c0e-ba20-b3f0e65beae7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:14.148202 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-62a96a2f-b2cf-4c0e-ba20-b3f0e65beae7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:14.148976 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-62a96a2f-b2cf-4c0e-ba20-b3f0e65beae7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:14.149520 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-62a96a2f-b2cf-4c0e-ba20-b3f0e65beae7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:14.169258 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-b768686b-6776-4f66-929a-33bd42315c1b req-a6e959d9-cbf3-48be-acfd-e9763f68124e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e", "name": "network-vif-plugged", "status": "completed", "tag": "a9ea99c7-9e9a-429a-a735-dcc12c181098"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:14.170853 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:24:14.170853 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:24:14.179103 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-b768686b-6776-4f66-929a-33bd42315c1b req-a6e959d9-cbf3-48be-acfd-e9763f68124e service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:14.179808 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-b768686b-6776-4f66-929a-33bd42315c1b req-a6e959d9-cbf3-48be-acfd-e9763f68124e service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:14.192307 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-b768686b-6776-4f66-929a-33bd42315c1b req-a6e959d9-cbf3-48be-acfd-e9763f68124e service nova] Creating event network-vif-plugged:a9ea99c7-9e9a-429a-a735-dcc12c181098 for instance b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e on hv-cinder-80403 Nov 24 15:24:14.197733 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-b768686b-6776-4f66-929a-33bd42315c1b req-a6e959d9-cbf3-48be-acfd-e9763f68124e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032071 Nov 24 15:24:14.198590 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 297/565] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:24:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:24:14.288846 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-62a96a2f-b2cf-4c0e-ba20-b3f0e65beae7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:14.297559 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-62a96a2f-b2cf-4c0e-ba20-b3f0e65beae7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:14.299089 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-62a96a2f-b2cf-4c0e-ba20-b3f0e65beae7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:14.300242 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-62a96a2f-b2cf-4c0e-ba20-b3f0e65beae7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1722 microversion: 2.20 time: 0.163783 Nov 24 15:24:14.300799 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 269/566] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:14 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:14.731703 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ad2dfd10-776c-49e6-96ad-3094b1c99cc7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:14.732304 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ad2dfd10-776c-49e6-96ad-3094b1c99cc7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:14.738356 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ad2dfd10-776c-49e6-96ad-3094b1c99cc7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:14.739094 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ad2dfd10-776c-49e6-96ad-3094b1c99cc7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:14.739871 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ad2dfd10-776c-49e6-96ad-3094b1c99cc7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:14.740306 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ad2dfd10-776c-49e6-96ad-3094b1c99cc7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:14.870646 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ad2dfd10-776c-49e6-96ad-3094b1c99cc7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:14.878015 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ad2dfd10-776c-49e6-96ad-3094b1c99cc7 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 200 len: 1362 microversion: 2.1 time: 0.150886 Nov 24 15:24:14.878588 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 298/567] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:14 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:15.319194 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8308c2fb-33a3-4869-89dc-c3003cd0ecdf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:15.319783 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8308c2fb-33a3-4869-89dc-c3003cd0ecdf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:15.326155 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8308c2fb-33a3-4869-89dc-c3003cd0ecdf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:15.326603 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8308c2fb-33a3-4869-89dc-c3003cd0ecdf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:15.327412 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8308c2fb-33a3-4869-89dc-c3003cd0ecdf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:15.328434 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8308c2fb-33a3-4869-89dc-c3003cd0ecdf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:15.461988 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8308c2fb-33a3-4869-89dc-c3003cd0ecdf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:15.470147 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8308c2fb-33a3-4869-89dc-c3003cd0ecdf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:15.471671 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8308c2fb-33a3-4869-89dc-c3003cd0ecdf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:15.472839 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8308c2fb-33a3-4869-89dc-c3003cd0ecdf tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1722 microversion: 2.20 time: 0.157382 Nov 24 15:24:15.473414 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 270/568] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:15 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:15.895635 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5925860a-6f88-4fee-835c-57e49cfba69f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:15.896276 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5925860a-6f88-4fee-835c-57e49cfba69f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:15.902635 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5925860a-6f88-4fee-835c-57e49cfba69f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:15.903115 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5925860a-6f88-4fee-835c-57e49cfba69f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:15.903896 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5925860a-6f88-4fee-835c-57e49cfba69f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:15.904399 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5925860a-6f88-4fee-835c-57e49cfba69f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:16.034631 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5925860a-6f88-4fee-835c-57e49cfba69f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:16.042478 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5925860a-6f88-4fee-835c-57e49cfba69f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 200 len: 1549 microversion: 2.1 time: 0.150486 Nov 24 15:24:16.043141 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 299/569] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:15 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:16.058280 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-417a4e76-5de2-492b-af4a-a00b42eeffe0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:16.058768 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-417a4e76-5de2-492b-af4a-a00b42eeffe0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:16.065018 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-417a4e76-5de2-492b-af4a-a00b42eeffe0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:16.065473 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-417a4e76-5de2-492b-af4a-a00b42eeffe0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:16.066317 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-417a4e76-5de2-492b-af4a-a00b42eeffe0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:16.066751 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-417a4e76-5de2-492b-af4a-a00b42eeffe0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:16.155867 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-417a4e76-5de2-492b-af4a-a00b42eeffe0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101077 Nov 24 15:24:16.156455 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 271/570] 10.222.0.66 () {58 vars in 1274 bytes} [Wed Nov 24 15:24:16 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:24:16.491190 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4789c028-de22-4840-b575-345f48dc97af tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:16.491801 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4789c028-de22-4840-b575-345f48dc97af tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:16.497713 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4789c028-de22-4840-b575-345f48dc97af tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:16.498166 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4789c028-de22-4840-b575-345f48dc97af tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:16.498980 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4789c028-de22-4840-b575-345f48dc97af tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:16.499990 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4789c028-de22-4840-b575-345f48dc97af tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:16.714928 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4789c028-de22-4840-b575-345f48dc97af tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:16.723114 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4789c028-de22-4840-b575-345f48dc97af tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:16.724620 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4789c028-de22-4840-b575-345f48dc97af tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:16.725776 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4789c028-de22-4840-b575-345f48dc97af tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1722 microversion: 2.20 time: 0.238672 Nov 24 15:24:16.726368 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 300/571] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:16 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:17.163392 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-d2893ffd-9e86-41f7-9148-9560f917fa50 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:17.164305 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-d2893ffd-9e86-41f7-9148-9560f917fa50 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:17.171525 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-15393c3e-b6bf-4ea4-b290-34c49f5dad29 req-9f0279d5-8c1d-4b42-8e2d-1f41f8246098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e", "tag": "a9ea99c7-9e9a-429a-a735-dcc12c181098"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:17.173005 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:24:17.173005 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:24:17.182262 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d2893ffd-9e86-41f7-9148-9560f917fa50 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:17.182840 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d2893ffd-9e86-41f7-9148-9560f917fa50 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:17.183382 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-15393c3e-b6bf-4ea4-b290-34c49f5dad29 req-9f0279d5-8c1d-4b42-8e2d-1f41f8246098 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:17.183634 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d2893ffd-9e86-41f7-9148-9560f917fa50 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:17.183821 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-15393c3e-b6bf-4ea4-b290-34c49f5dad29 req-9f0279d5-8c1d-4b42-8e2d-1f41f8246098 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:17.184071 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d2893ffd-9e86-41f7-9148-9560f917fa50 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:17.196705 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-15393c3e-b6bf-4ea4-b290-34c49f5dad29 req-9f0279d5-8c1d-4b42-8e2d-1f41f8246098 service nova] Creating event network-changed:a9ea99c7-9e9a-429a-a735-dcc12c181098 for instance b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e on hv-cinder-80403 Nov 24 15:24:17.201585 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-15393c3e-b6bf-4ea4-b290-34c49f5dad29 req-9f0279d5-8c1d-4b42-8e2d-1f41f8246098 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033482 Nov 24 15:24:17.202186 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 301/572] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:24:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:24:17.245733 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-d2893ffd-9e86-41f7-9148-9560f917fa50 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 14 microversion: 2.1 time: 0.084237 Nov 24 15:24:17.245998 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 272/573] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:17 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:24:17.745144 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-eacaa780-279a-4230-b15d-493dbb249a40 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:17.746031 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-eacaa780-279a-4230-b15d-493dbb249a40 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:17.752715 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eacaa780-279a-4230-b15d-493dbb249a40 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:17.753159 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eacaa780-279a-4230-b15d-493dbb249a40 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:17.753964 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eacaa780-279a-4230-b15d-493dbb249a40 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:17.754390 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eacaa780-279a-4230-b15d-493dbb249a40 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:17.895019 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-eacaa780-279a-4230-b15d-493dbb249a40 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:17.903338 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-eacaa780-279a-4230-b15d-493dbb249a40 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:17.905024 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-eacaa780-279a-4230-b15d-493dbb249a40 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:17.906966 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-eacaa780-279a-4230-b15d-493dbb249a40 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1743 microversion: 2.20 time: 0.165977 Nov 24 15:24:17.907530 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 302/574] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:17 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:18.256058 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-9989bd14-4ad4-442c-9825-088392ba1f73 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:18.257117 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-9989bd14-4ad4-442c-9825-088392ba1f73 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:18.264330 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9989bd14-4ad4-442c-9825-088392ba1f73 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:18.264752 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9989bd14-4ad4-442c-9825-088392ba1f73 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:18.265630 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9989bd14-4ad4-442c-9825-088392ba1f73 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:18.266071 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9989bd14-4ad4-442c-9825-088392ba1f73 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:18.343430 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-9989bd14-4ad4-442c-9825-088392ba1f73 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 14 microversion: 2.1 time: 0.091131 Nov 24 15:24:18.346394 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 273/575] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:18 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:24:18.925661 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2b1e087a-3c13-4c5c-9b3d-ac8e4e414a23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:18.926270 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2b1e087a-3c13-4c5c-9b3d-ac8e4e414a23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:18.932750 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2b1e087a-3c13-4c5c-9b3d-ac8e4e414a23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:18.933202 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2b1e087a-3c13-4c5c-9b3d-ac8e4e414a23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:18.934238 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2b1e087a-3c13-4c5c-9b3d-ac8e4e414a23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:18.934867 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2b1e087a-3c13-4c5c-9b3d-ac8e4e414a23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:19.071384 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2b1e087a-3c13-4c5c-9b3d-ac8e4e414a23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:19.079409 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2b1e087a-3c13-4c5c-9b3d-ac8e4e414a23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:19.080907 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2b1e087a-3c13-4c5c-9b3d-ac8e4e414a23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:19.082064 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2b1e087a-3c13-4c5c-9b3d-ac8e4e414a23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1743 microversion: 2.20 time: 0.160682 Nov 24 15:24:19.082632 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 303/576] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:18 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:19.354194 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-e87d0746-136b-4acf-af2b-35d6fd0ffc77 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:19.355829 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-e87d0746-136b-4acf-af2b-35d6fd0ffc77 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:19.370725 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e87d0746-136b-4acf-af2b-35d6fd0ffc77 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:19.370725 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e87d0746-136b-4acf-af2b-35d6fd0ffc77 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:19.370725 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e87d0746-136b-4acf-af2b-35d6fd0ffc77 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:19.370725 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e87d0746-136b-4acf-af2b-35d6fd0ffc77 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:19.441023 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-e87d0746-136b-4acf-af2b-35d6fd0ffc77 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 14 microversion: 2.1 time: 0.090608 Nov 24 15:24:19.441609 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 274/577] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:19 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:24:20.099783 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c0a33230-9d34-44b2-9a9f-1cd1acb3fed6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:20.100493 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c0a33230-9d34-44b2-9a9f-1cd1acb3fed6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:20.107077 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0a33230-9d34-44b2-9a9f-1cd1acb3fed6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:20.107807 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0a33230-9d34-44b2-9a9f-1cd1acb3fed6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:20.109450 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0a33230-9d34-44b2-9a9f-1cd1acb3fed6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:20.109847 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0a33230-9d34-44b2-9a9f-1cd1acb3fed6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:20.256479 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c0a33230-9d34-44b2-9a9f-1cd1acb3fed6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:20.266399 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c0a33230-9d34-44b2-9a9f-1cd1acb3fed6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:20.267927 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c0a33230-9d34-44b2-9a9f-1cd1acb3fed6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:20.269113 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c0a33230-9d34-44b2-9a9f-1cd1acb3fed6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1738 microversion: 2.20 time: 0.173009 Nov 24 15:24:20.280711 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 304/578] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:20 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:20.452818 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f7c228e8-61b7-472c-9470-0dd88d846de9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:20.453811 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-f7c228e8-61b7-472c-9470-0dd88d846de9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:20.460457 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f7c228e8-61b7-472c-9470-0dd88d846de9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:20.461134 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f7c228e8-61b7-472c-9470-0dd88d846de9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:20.462099 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f7c228e8-61b7-472c-9470-0dd88d846de9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:20.462706 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f7c228e8-61b7-472c-9470-0dd88d846de9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:20.526068 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f7c228e8-61b7-472c-9470-0dd88d846de9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 14 microversion: 2.1 time: 0.076997 Nov 24 15:24:20.526997 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 275/579] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:20 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:24:21.295045 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9fd4dee8-14f7-418f-81f2-7bc6c9dddc4f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:21.295710 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9fd4dee8-14f7-418f-81f2-7bc6c9dddc4f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:21.302725 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9fd4dee8-14f7-418f-81f2-7bc6c9dddc4f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:21.303248 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9fd4dee8-14f7-418f-81f2-7bc6c9dddc4f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:21.304394 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9fd4dee8-14f7-418f-81f2-7bc6c9dddc4f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:21.304827 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9fd4dee8-14f7-418f-81f2-7bc6c9dddc4f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:21.462648 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9fd4dee8-14f7-418f-81f2-7bc6c9dddc4f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:21.471875 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9fd4dee8-14f7-418f-81f2-7bc6c9dddc4f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:21.473364 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9fd4dee8-14f7-418f-81f2-7bc6c9dddc4f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:21.474519 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9fd4dee8-14f7-418f-81f2-7bc6c9dddc4f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1738 microversion: 2.20 time: 0.183795 Nov 24 15:24:21.485470 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 305/580] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:21 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:21.538186 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-7668cdfc-b374-45d3-be80-a118b1725926 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:21.539214 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-7668cdfc-b374-45d3-be80-a118b1725926 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:21.546638 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7668cdfc-b374-45d3-be80-a118b1725926 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:21.547378 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7668cdfc-b374-45d3-be80-a118b1725926 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:21.548169 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7668cdfc-b374-45d3-be80-a118b1725926 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:21.548610 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7668cdfc-b374-45d3-be80-a118b1725926 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:21.609309 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-7668cdfc-b374-45d3-be80-a118b1725926 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 14 microversion: 2.1 time: 0.075007 Nov 24 15:24:21.609943 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 276/581] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:21 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:24:22.247914 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-d072a1ee-aaf5-4103-8ee0-dfc0f9176874 req-a9075a13-c492-4639-bd3d-091048d3de1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361e1e6c-853b-4fde-89ed-843a85be79c1", "name": "network-vif-plugged", "status": "completed", "tag": "66d6070e-c6fb-4ac7-8705-204f502bc368"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:22.250724 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:24:22.250724 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:24:22.269714 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-d072a1ee-aaf5-4103-8ee0-dfc0f9176874 req-a9075a13-c492-4639-bd3d-091048d3de1c service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:22.270322 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-d072a1ee-aaf5-4103-8ee0-dfc0f9176874 req-a9075a13-c492-4639-bd3d-091048d3de1c service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:22.290168 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-d072a1ee-aaf5-4103-8ee0-dfc0f9176874 req-a9075a13-c492-4639-bd3d-091048d3de1c service nova] Creating event network-vif-plugged:66d6070e-c6fb-4ac7-8705-204f502bc368 for instance 361e1e6c-853b-4fde-89ed-843a85be79c1 on hv-cinder-80403 Nov 24 15:24:22.295660 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-d072a1ee-aaf5-4103-8ee0-dfc0f9176874 req-a9075a13-c492-4639-bd3d-091048d3de1c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051586 Nov 24 15:24:22.297155 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 306/582] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:24:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:24:22.495663 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c767142c-e892-44c2-8928-5a06586da27a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:22.496647 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c767142c-e892-44c2-8928-5a06586da27a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:22.504367 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c767142c-e892-44c2-8928-5a06586da27a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:22.504822 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c767142c-e892-44c2-8928-5a06586da27a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:22.505666 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c767142c-e892-44c2-8928-5a06586da27a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:22.506111 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c767142c-e892-44c2-8928-5a06586da27a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:22.545374 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7c43a9ad-5c4a-4817-bb6c-e02cbaa9f777 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:22.546876 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7c43a9ad-5c4a-4817-bb6c-e02cbaa9f777 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:22.556621 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7c43a9ad-5c4a-4817-bb6c-e02cbaa9f777 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:22.559231 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7c43a9ad-5c4a-4817-bb6c-e02cbaa9f777 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:22.561041 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7c43a9ad-5c4a-4817-bb6c-e02cbaa9f777 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:22.562187 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7c43a9ad-5c4a-4817-bb6c-e02cbaa9f777 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:22.599905 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7c43a9ad-5c4a-4817-bb6c-e02cbaa9f777 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:24:22.669607 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c767142c-e892-44c2-8928-5a06586da27a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:22.682055 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c767142c-e892-44c2-8928-5a06586da27a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:22.683898 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c767142c-e892-44c2-8928-5a06586da27a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:22.685254 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c767142c-e892-44c2-8928-5a06586da27a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1738 microversion: 2.20 time: 0.196247 Nov 24 15:24:22.696288 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7c43a9ad-5c4a-4817-bb6c-e02cbaa9f777 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 204 len: 0 microversion: 2.1 time: 0.154238 Nov 24 15:24:22.696758 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 307/583] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:24:22 2021] DELETE /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 15:24:22.697295 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 277/584] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:22 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:22.703489 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-eb61c0bb-00ff-4b37-886c-a6fdf5b3fa78 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:22.704477 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-eb61c0bb-00ff-4b37-886c-a6fdf5b3fa78 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:22.705194 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c462d193-9d5a-4fa0-ab13-239371f089cf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:22.705817 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c462d193-9d5a-4fa0-ab13-239371f089cf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:22.713005 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eb61c0bb-00ff-4b37-886c-a6fdf5b3fa78 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:22.713281 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c462d193-9d5a-4fa0-ab13-239371f089cf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:22.713688 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eb61c0bb-00ff-4b37-886c-a6fdf5b3fa78 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:22.714105 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c462d193-9d5a-4fa0-ab13-239371f089cf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:22.714548 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eb61c0bb-00ff-4b37-886c-a6fdf5b3fa78 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:22.715043 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eb61c0bb-00ff-4b37-886c-a6fdf5b3fa78 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:22.715485 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c462d193-9d5a-4fa0-ab13-239371f089cf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:22.716090 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c462d193-9d5a-4fa0-ab13-239371f089cf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:22.797279 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-eb61c0bb-00ff-4b37-886c-a6fdf5b3fa78 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 14 microversion: 2.1 time: 0.098572 Nov 24 15:24:22.800796 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 308/585] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:22 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:24:22.875181 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c462d193-9d5a-4fa0-ab13-239371f089cf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:22.883320 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c462d193-9d5a-4fa0-ab13-239371f089cf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1578 microversion: 2.1 time: 0.181701 Nov 24 15:24:22.883919 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 278/586] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:22 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:24:23.705053 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-160d0a83-6d5c-47fe-87b8-8864dec3bc4c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:23.705874 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-160d0a83-6d5c-47fe-87b8-8864dec3bc4c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:23.712491 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-160d0a83-6d5c-47fe-87b8-8864dec3bc4c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:23.712954 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-160d0a83-6d5c-47fe-87b8-8864dec3bc4c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:23.713761 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-160d0a83-6d5c-47fe-87b8-8864dec3bc4c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:23.714201 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-160d0a83-6d5c-47fe-87b8-8864dec3bc4c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:23.809726 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a0313c84-895e-4c05-af77-81c133d4bfcf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:23.813242 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a0313c84-895e-4c05-af77-81c133d4bfcf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:23.819937 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a0313c84-895e-4c05-af77-81c133d4bfcf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:23.820393 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a0313c84-895e-4c05-af77-81c133d4bfcf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:23.821196 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a0313c84-895e-4c05-af77-81c133d4bfcf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:23.821638 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a0313c84-895e-4c05-af77-81c133d4bfcf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:23.873501 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-160d0a83-6d5c-47fe-87b8-8864dec3bc4c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:23.881896 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-160d0a83-6d5c-47fe-87b8-8864dec3bc4c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:23.883502 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-160d0a83-6d5c-47fe-87b8-8864dec3bc4c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:23.884921 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-160d0a83-6d5c-47fe-87b8-8864dec3bc4c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1738 microversion: 2.20 time: 0.184591 Nov 24 15:24:23.885506 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 309/587] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:23 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:23.896733 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a0313c84-895e-4c05-af77-81c133d4bfcf tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 14 microversion: 2.1 time: 0.091144 Nov 24 15:24:23.897365 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 279/588] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:23 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 15:24:23.917443 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b1993d7b-2949-4f55-9e2a-233454a6a415 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:23.918056 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b1993d7b-2949-4f55-9e2a-233454a6a415 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:23.924036 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1993d7b-2949-4f55-9e2a-233454a6a415 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:23.924487 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1993d7b-2949-4f55-9e2a-233454a6a415 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:23.926833 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1993d7b-2949-4f55-9e2a-233454a6a415 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:23.926833 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1993d7b-2949-4f55-9e2a-233454a6a415 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:24.091729 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b1993d7b-2949-4f55-9e2a-233454a6a415 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:24.099261 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b1993d7b-2949-4f55-9e2a-233454a6a415 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1578 microversion: 2.1 time: 0.185789 Nov 24 15:24:24.109141 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 310/589] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:23 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1578 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:24.904856 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-44786f87-e449-4cf9-a278-7a5ce2bfa7a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:24.906198 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-44786f87-e449-4cf9-a278-7a5ce2bfa7a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:24.910067 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-84722f85-67ca-45ff-b823-27fe881ad169 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:24.911075 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-84722f85-67ca-45ff-b823-27fe881ad169 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:24.913982 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-44786f87-e449-4cf9-a278-7a5ce2bfa7a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:24.914447 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-44786f87-e449-4cf9-a278-7a5ce2bfa7a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:24.915281 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-44786f87-e449-4cf9-a278-7a5ce2bfa7a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:24.915722 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-44786f87-e449-4cf9-a278-7a5ce2bfa7a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:24.926291 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84722f85-67ca-45ff-b823-27fe881ad169 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:24.929168 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84722f85-67ca-45ff-b823-27fe881ad169 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:24.930001 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84722f85-67ca-45ff-b823-27fe881ad169 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:24.932084 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84722f85-67ca-45ff-b823-27fe881ad169 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:25.010542 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-84722f85-67ca-45ff-b823-27fe881ad169 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 14 microversion: 2.1 time: 0.107054 Nov 24 15:24:25.013771 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 311/590] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:24 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:24:25.087697 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-44786f87-e449-4cf9-a278-7a5ce2bfa7a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:25.096598 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-44786f87-e449-4cf9-a278-7a5ce2bfa7a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:25.098444 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-44786f87-e449-4cf9-a278-7a5ce2bfa7a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:25.099773 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-44786f87-e449-4cf9-a278-7a5ce2bfa7a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1738 microversion: 2.20 time: 0.199561 Nov 24 15:24:25.100448 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 280/591] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:24 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:25.119081 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9644de58-81d6-4f5f-8724-9652539507e4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:25.119793 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9644de58-81d6-4f5f-8724-9652539507e4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:25.126481 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9644de58-81d6-4f5f-8724-9652539507e4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:25.126964 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9644de58-81d6-4f5f-8724-9652539507e4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:25.127749 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9644de58-81d6-4f5f-8724-9652539507e4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:25.128186 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9644de58-81d6-4f5f-8724-9652539507e4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:25.304900 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9644de58-81d6-4f5f-8724-9652539507e4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:25.315294 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9644de58-81d6-4f5f-8724-9652539507e4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1578 microversion: 2.1 time: 0.200080 Nov 24 15:24:25.325532 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 312/592] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:25 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1578 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:25.700247 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-34ca7110-aced-4f83-8a25-20e458c8d226 req-7b6253c9-ae07-4fd5-ba38-b537f19a4a6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a77d835-ce70-43fb-ab67-3b41127405d3", "name": "network-vif-deleted", "tag": "1aaa1843-b387-4a3e-a5f5-e558eab342ed"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:25.701759 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:24:25.701759 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:24:25.713680 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-34ca7110-aced-4f83-8a25-20e458c8d226 req-7b6253c9-ae07-4fd5-ba38-b537f19a4a6d service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:25.714199 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-34ca7110-aced-4f83-8a25-20e458c8d226 req-7b6253c9-ae07-4fd5-ba38-b537f19a4a6d service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:25.740150 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-34ca7110-aced-4f83-8a25-20e458c8d226 req-7b6253c9-ae07-4fd5-ba38-b537f19a4a6d service nova] Creating event network-vif-deleted:1aaa1843-b387-4a3e-a5f5-e558eab342ed for instance 1a77d835-ce70-43fb-ab67-3b41127405d3 on hv-cinder-80403 Nov 24 15:24:25.758560 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-34ca7110-aced-4f83-8a25-20e458c8d226 req-7b6253c9-ae07-4fd5-ba38-b537f19a4a6d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061587 Nov 24 15:24:25.759687 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 281/593] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:24:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:24:26.021378 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1ad6ef5d-bd0c-4433-9a37-af6026d3f67a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:26.028429 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1ad6ef5d-bd0c-4433-9a37-af6026d3f67a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:26.044036 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ad6ef5d-bd0c-4433-9a37-af6026d3f67a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:26.044495 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ad6ef5d-bd0c-4433-9a37-af6026d3f67a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:26.049789 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ad6ef5d-bd0c-4433-9a37-af6026d3f67a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:26.051644 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1ad6ef5d-bd0c-4433-9a37-af6026d3f67a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:26.122463 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-427a824b-9f30-4090-b79d-733ef2592db8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:26.125156 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-427a824b-9f30-4090-b79d-733ef2592db8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:26.131075 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1ad6ef5d-bd0c-4433-9a37-af6026d3f67a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 14 microversion: 2.1 time: 0.113210 Nov 24 15:24:26.132156 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 313/594] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:26 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:24:26.139708 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-427a824b-9f30-4090-b79d-733ef2592db8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:26.140030 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-427a824b-9f30-4090-b79d-733ef2592db8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:26.140839 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-427a824b-9f30-4090-b79d-733ef2592db8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:26.141281 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-427a824b-9f30-4090-b79d-733ef2592db8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:26.304178 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-427a824b-9f30-4090-b79d-733ef2592db8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:26.315776 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-427a824b-9f30-4090-b79d-733ef2592db8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:26.317552 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-427a824b-9f30-4090-b79d-733ef2592db8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:26.318716 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-427a824b-9f30-4090-b79d-733ef2592db8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1738 microversion: 2.20 time: 0.201198 Nov 24 15:24:26.319344 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 282/595] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:26 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:26.341600 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-99d5e3a5-80ca-4a4e-850a-4d6a82a76f52 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:26.343129 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-99d5e3a5-80ca-4a4e-850a-4d6a82a76f52 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:26.350507 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99d5e3a5-80ca-4a4e-850a-4d6a82a76f52 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:26.351222 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99d5e3a5-80ca-4a4e-850a-4d6a82a76f52 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:26.352176 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99d5e3a5-80ca-4a4e-850a-4d6a82a76f52 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:26.352772 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99d5e3a5-80ca-4a4e-850a-4d6a82a76f52 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:26.395369 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99d5e3a5-80ca-4a4e-850a-4d6a82a76f52 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:26.396076 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-99d5e3a5-80ca-4a4e-850a-4d6a82a76f52 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:26.399161 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-99d5e3a5-80ca-4a4e-850a-4d6a82a76f52 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lazy-loading 'fault' on Instance uuid 1a77d835-ce70-43fb-ab67-3b41127405d3 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:24:26.732920 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-99d5e3a5-80ca-4a4e-850a-4d6a82a76f52 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:26.741323 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-99d5e3a5-80ca-4a4e-850a-4d6a82a76f52 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 200 len: 1185 microversion: 2.1 time: 0.406825 Nov 24 15:24:26.751190 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 314/596] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:26 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 1185 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:27.142916 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-dea6c423-2b38-4c84-a939-967a6e82cd8e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:27.143973 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-dea6c423-2b38-4c84-a939-967a6e82cd8e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:27.151115 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dea6c423-2b38-4c84-a939-967a6e82cd8e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:27.151889 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dea6c423-2b38-4c84-a939-967a6e82cd8e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:27.152945 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dea6c423-2b38-4c84-a939-967a6e82cd8e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:27.153744 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dea6c423-2b38-4c84-a939-967a6e82cd8e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:27.226596 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-dea6c423-2b38-4c84-a939-967a6e82cd8e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 14 microversion: 2.1 time: 0.087484 Nov 24 15:24:27.227756 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 283/597] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:27 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:24:27.340896 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-91d5a332-82a4-41ee-8183-7456e515a9c0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:27.343136 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-91d5a332-82a4-41ee-8183-7456e515a9c0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:27.349953 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-91d5a332-82a4-41ee-8183-7456e515a9c0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:27.350691 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-91d5a332-82a4-41ee-8183-7456e515a9c0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:27.351705 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-91d5a332-82a4-41ee-8183-7456e515a9c0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:27.352296 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-91d5a332-82a4-41ee-8183-7456e515a9c0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:27.514780 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-91d5a332-82a4-41ee-8183-7456e515a9c0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:27.523068 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-91d5a332-82a4-41ee-8183-7456e515a9c0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:27.524579 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-91d5a332-82a4-41ee-8183-7456e515a9c0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:27.525762 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-91d5a332-82a4-41ee-8183-7456e515a9c0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1738 microversion: 2.20 time: 0.190923 Nov 24 15:24:27.526659 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 315/598] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:27 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:27.759104 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4f9b75cd-2db6-4830-b009-46d19184e129 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:27.759823 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4f9b75cd-2db6-4830-b009-46d19184e129 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:27.769277 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4f9b75cd-2db6-4830-b009-46d19184e129 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:27.769821 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4f9b75cd-2db6-4830-b009-46d19184e129 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:27.770684 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4f9b75cd-2db6-4830-b009-46d19184e129 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:27.771245 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4f9b75cd-2db6-4830-b009-46d19184e129 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:27.786230 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-4f9b75cd-2db6-4830-b009-46d19184e129 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] HTTP exception thrown: Instance 1a77d835-ce70-43fb-ab67-3b41127405d3 could not be found. Nov 24 15:24:27.786954 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4f9b75cd-2db6-4830-b009-46d19184e129 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Returning 404 to user: Instance 1a77d835-ce70-43fb-ab67-3b41127405d3 could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:24:27.787854 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4f9b75cd-2db6-4830-b009-46d19184e129 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 404 len: 111 microversion: 2.1 time: 0.032896 Nov 24 15:24:27.788492 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 284/599] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:27 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:24:27.898201 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-898555793", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1044302524", "security_groups": [{"name": "tempest-secgroup-smoke-1039673694"}], "block_device_mapping_v2": [{"uuid": "bc225131-4c43-430a-9e47-dc69b22ce2c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f26750e4-e797-4f7f-b557-e7463bad5d42"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:28.031477 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] validate_networks() for [('f26750e4-e797-4f7f-b557-e7463bad5d42', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:24:28.237604 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-7c962e83-6f5f-4269-9866-0198e978e78a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:28.239409 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-7c962e83-6f5f-4269-9866-0198e978e78a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:28.253703 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7c962e83-6f5f-4269-9866-0198e978e78a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:28.254147 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7c962e83-6f5f-4269-9866-0198e978e78a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:28.255181 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7c962e83-6f5f-4269-9866-0198e978e78a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:28.255798 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7c962e83-6f5f-4269-9866-0198e978e78a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:28.341078 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-7c962e83-6f5f-4269-9866-0198e978e78a tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 2984 microversion: 2.1 time: 0.107003 Nov 24 15:24:28.346399 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 285/600] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:28 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 2984 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:28.444936 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:24:28.446085 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:24:28.446722 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:24:28.447168 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:24:28.447580 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:24:28.457330 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:28.457782 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:28.458601 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:28.458601 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:28.477572 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Getting quotas for project b981a3c2d7974c7ca0c54a5262ea5220. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:24:28.482277 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Getting quotas for user ad76e9906e5341869af05aace8368403 and project b981a3c2d7974c7ca0c54a5262ea5220. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:24:28.546091 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-1bb60a55-5e2b-40d1-9b77-eb165740cebe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:28.547466 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-1bb60a55-5e2b-40d1-9b77-eb165740cebe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:28.549608 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:24:28.552861 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc225131-4c43-430a-9e47-dc69b22ce2c4',volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:24:28.555838 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1bb60a55-5e2b-40d1-9b77-eb165740cebe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:28.556588 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1bb60a55-5e2b-40d1-9b77-eb165740cebe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:28.557743 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1bb60a55-5e2b-40d1-9b77-eb165740cebe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:28.558401 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1bb60a55-5e2b-40d1-9b77-eb165740cebe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:28.731498 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-92e08995-67e4-452d-a751-3780cfe2ab79 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.837371 Nov 24 15:24:28.742766 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 316/601] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:24:27 2021] POST /compute/v2.1/servers => generated 406 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:24:28.747862 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-53c3cb59-ef98-4f31-a05c-cdc346e5d40d tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:28.753595 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-53c3cb59-ef98-4f31-a05c-cdc346e5d40d tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:28.817354 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-53c3cb59-ef98-4f31-a05c-cdc346e5d40d tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:28.831023 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-53c3cb59-ef98-4f31-a05c-cdc346e5d40d tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1094 microversion: 2.1 time: 0.085165 Nov 24 15:24:28.836210 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 317/602] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:28 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1094 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:28.860214 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-1bb60a55-5e2b-40d1-9b77-eb165740cebe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:28.869968 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-1bb60a55-5e2b-40d1-9b77-eb165740cebe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:28.871695 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-1bb60a55-5e2b-40d1-9b77-eb165740cebe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:28.872901 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-1bb60a55-5e2b-40d1-9b77-eb165740cebe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1738 microversion: 2.20 time: 0.331094 Nov 24 15:24:28.874408 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 286/603] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:28 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:29.353351 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d9236fb7-f427-4478-bc40-d251e368523d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:29.354319 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d9236fb7-f427-4478-bc40-d251e368523d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:29.361871 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9236fb7-f427-4478-bc40-d251e368523d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:29.363096 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9236fb7-f427-4478-bc40-d251e368523d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:29.364137 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9236fb7-f427-4478-bc40-d251e368523d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:29.364905 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9236fb7-f427-4478-bc40-d251e368523d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:29.441724 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d9236fb7-f427-4478-bc40-d251e368523d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 14772 microversion: 2.1 time: 0.091868 Nov 24 15:24:29.442374 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 318/604] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:29 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 14772 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:24:29.852521 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2b0279bd-8209-4b5c-b7db-78cb7c1a41a3 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:29.853178 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2b0279bd-8209-4b5c-b7db-78cb7c1a41a3 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:29.860902 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2b0279bd-8209-4b5c-b7db-78cb7c1a41a3 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:29.861625 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2b0279bd-8209-4b5c-b7db-78cb7c1a41a3 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:29.862587 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2b0279bd-8209-4b5c-b7db-78cb7c1a41a3 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:29.863077 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2b0279bd-8209-4b5c-b7db-78cb7c1a41a3 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:29.892152 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bdbeefd7-6fab-46d2-977d-6bd19d14c5ff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:29.892839 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bdbeefd7-6fab-46d2-977d-6bd19d14c5ff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:29.901136 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bdbeefd7-6fab-46d2-977d-6bd19d14c5ff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:29.901584 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bdbeefd7-6fab-46d2-977d-6bd19d14c5ff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:29.902372 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bdbeefd7-6fab-46d2-977d-6bd19d14c5ff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:29.902824 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bdbeefd7-6fab-46d2-977d-6bd19d14c5ff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:29.962539 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-2b0279bd-8209-4b5c-b7db-78cb7c1a41a3 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:29.981240 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2b0279bd-8209-4b5c-b7db-78cb7c1a41a3 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1200 microversion: 2.1 time: 0.132249 Nov 24 15:24:29.982119 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 287/605] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:29 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1200 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:30.074110 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bdbeefd7-6fab-46d2-977d-6bd19d14c5ff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:30.083073 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bdbeefd7-6fab-46d2-977d-6bd19d14c5ff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:30.084923 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bdbeefd7-6fab-46d2-977d-6bd19d14c5ff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:30.086158 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bdbeefd7-6fab-46d2-977d-6bd19d14c5ff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1738 microversion: 2.20 time: 0.198015 Nov 24 15:24:30.086715 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 319/606] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:29 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1738 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:30.452759 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6f15e352-cea1-4fe7-9ae6-2aab8fc9ef9d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:30.454254 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6f15e352-cea1-4fe7-9ae6-2aab8fc9ef9d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:30.460729 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6f15e352-cea1-4fe7-9ae6-2aab8fc9ef9d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:30.461446 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6f15e352-cea1-4fe7-9ae6-2aab8fc9ef9d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:30.462554 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6f15e352-cea1-4fe7-9ae6-2aab8fc9ef9d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:30.463130 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6f15e352-cea1-4fe7-9ae6-2aab8fc9ef9d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:30.535206 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6f15e352-cea1-4fe7-9ae6-2aab8fc9ef9d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 18356 microversion: 2.1 time: 0.086315 Nov 24 15:24:30.539747 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 288/607] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:30 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 18356 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:24:31.000156 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-61d9b632-4d75-4289-aeae-bccef484a7ef tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:31.000913 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-61d9b632-4d75-4289-aeae-bccef484a7ef tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:31.010162 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-61d9b632-4d75-4289-aeae-bccef484a7ef tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:31.011233 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-61d9b632-4d75-4289-aeae-bccef484a7ef tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:31.012350 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-61d9b632-4d75-4289-aeae-bccef484a7ef tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:31.012809 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-61d9b632-4d75-4289-aeae-bccef484a7ef tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:31.104669 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3f9faed3-d1ee-4b89-a9fd-6dd4da92033f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:31.105565 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3f9faed3-d1ee-4b89-a9fd-6dd4da92033f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:31.112677 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f9faed3-d1ee-4b89-a9fd-6dd4da92033f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:31.113248 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f9faed3-d1ee-4b89-a9fd-6dd4da92033f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:31.114555 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f9faed3-d1ee-4b89-a9fd-6dd4da92033f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:31.115159 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f9faed3-d1ee-4b89-a9fd-6dd4da92033f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:31.174044 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-61d9b632-4d75-4289-aeae-bccef484a7ef tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:31.185828 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-61d9b632-4d75-4289-aeae-bccef484a7ef tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.189899 Nov 24 15:24:31.186527 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 320/608] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:30 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:31.264726 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-3f9faed3-d1ee-4b89-a9fd-6dd4da92033f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:31.272629 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-3f9faed3-d1ee-4b89-a9fd-6dd4da92033f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:31.274151 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-3f9faed3-d1ee-4b89-a9fd-6dd4da92033f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:31.275348 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3f9faed3-d1ee-4b89-a9fd-6dd4da92033f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1720 microversion: 2.20 time: 0.174737 Nov 24 15:24:31.275904 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 289/609] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:31 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:31.547066 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-58f3ac1e-4456-40aa-921b-039bacfb67b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:31.547990 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-58f3ac1e-4456-40aa-921b-039bacfb67b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:31.554617 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-58f3ac1e-4456-40aa-921b-039bacfb67b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:31.555324 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-58f3ac1e-4456-40aa-921b-039bacfb67b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:31.556110 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-58f3ac1e-4456-40aa-921b-039bacfb67b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:31.556703 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-58f3ac1e-4456-40aa-921b-039bacfb67b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:31.634174 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-9ea43902-2337-43df-96ed-cc1b6c02b5a7 req-b320494f-f0a4-4765-870d-896cf38784a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246791eb-b0eb-44f0-9417-f106580a57f5", "tag": "140a8110-eae9-4c4f-bc1c-8a0a2e8b5413"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:31.635707 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:24:31.635707 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:24:31.643803 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-9ea43902-2337-43df-96ed-cc1b6c02b5a7 req-b320494f-f0a4-4765-870d-896cf38784a1 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:31.644254 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-9ea43902-2337-43df-96ed-cc1b6c02b5a7 req-b320494f-f0a4-4765-870d-896cf38784a1 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:31.645034 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-58f3ac1e-4456-40aa-921b-039bacfb67b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 19342 microversion: 2.1 time: 0.101878 Nov 24 15:24:31.645912 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 321/610] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:31 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 19342 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:24:31.663248 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-9ea43902-2337-43df-96ed-cc1b6c02b5a7 req-b320494f-f0a4-4765-870d-896cf38784a1 service nova] Creating event network-changed:140a8110-eae9-4c4f-bc1c-8a0a2e8b5413 for instance 246791eb-b0eb-44f0-9417-f106580a57f5 on hv-cinder-80403 Nov 24 15:24:31.670149 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-9ea43902-2337-43df-96ed-cc1b6c02b5a7 req-b320494f-f0a4-4765-870d-896cf38784a1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039445 Nov 24 15:24:31.671406 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 290/611] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:24:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:24:32.204151 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-df078743-a993-4abf-92d8-580eb2a75813 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:32.205295 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-df078743-a993-4abf-92d8-580eb2a75813 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:32.211669 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df078743-a993-4abf-92d8-580eb2a75813 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:32.212124 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df078743-a993-4abf-92d8-580eb2a75813 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:32.212942 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df078743-a993-4abf-92d8-580eb2a75813 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:32.213385 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df078743-a993-4abf-92d8-580eb2a75813 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:32.294364 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-9dc533d2-0ab7-41b9-b6f9-b24d61d39f23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:32.295347 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-9dc533d2-0ab7-41b9-b6f9-b24d61d39f23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:32.301913 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9dc533d2-0ab7-41b9-b6f9-b24d61d39f23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:32.302501 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9dc533d2-0ab7-41b9-b6f9-b24d61d39f23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:32.303437 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9dc533d2-0ab7-41b9-b6f9-b24d61d39f23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:32.303974 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9dc533d2-0ab7-41b9-b6f9-b24d61d39f23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:32.360704 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-df078743-a993-4abf-92d8-580eb2a75813 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:32.368478 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-df078743-a993-4abf-92d8-580eb2a75813 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.168862 Nov 24 15:24:32.369109 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 322/612] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:32 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:32.445986 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-9dc533d2-0ab7-41b9-b6f9-b24d61d39f23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:32.454903 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-9dc533d2-0ab7-41b9-b6f9-b24d61d39f23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:32.456397 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-9dc533d2-0ab7-41b9-b6f9-b24d61d39f23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:32.457541 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-9dc533d2-0ab7-41b9-b6f9-b24d61d39f23 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1720 microversion: 2.20 time: 0.167668 Nov 24 15:24:32.458100 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 291/613] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:32 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:32.656401 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4d2c1b20-791a-467d-a11d-7624e11e9079 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:32.657309 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4d2c1b20-791a-467d-a11d-7624e11e9079 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:32.663645 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4d2c1b20-791a-467d-a11d-7624e11e9079 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:32.664098 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4d2c1b20-791a-467d-a11d-7624e11e9079 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:32.664886 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4d2c1b20-791a-467d-a11d-7624e11e9079 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:32.665318 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4d2c1b20-791a-467d-a11d-7624e11e9079 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:32.743734 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4d2c1b20-791a-467d-a11d-7624e11e9079 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 21570 microversion: 2.1 time: 0.090743 Nov 24 15:24:32.744369 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 323/614] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:32 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 21570 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:24:33.385714 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-27fe8ac8-208c-4536-9f8a-fb06f0ae4ae9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:33.386310 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-27fe8ac8-208c-4536-9f8a-fb06f0ae4ae9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:33.392968 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-27fe8ac8-208c-4536-9f8a-fb06f0ae4ae9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:33.393414 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-27fe8ac8-208c-4536-9f8a-fb06f0ae4ae9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:33.394183 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-27fe8ac8-208c-4536-9f8a-fb06f0ae4ae9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:33.394608 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-27fe8ac8-208c-4536-9f8a-fb06f0ae4ae9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:33.476076 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0a1ee82f-9618-48fc-b2ae-449066143d8a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:33.476850 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0a1ee82f-9618-48fc-b2ae-449066143d8a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:33.483762 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0a1ee82f-9618-48fc-b2ae-449066143d8a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:33.484244 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0a1ee82f-9618-48fc-b2ae-449066143d8a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:33.485073 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0a1ee82f-9618-48fc-b2ae-449066143d8a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:33.485511 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0a1ee82f-9618-48fc-b2ae-449066143d8a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:33.542508 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-27fe8ac8-208c-4536-9f8a-fb06f0ae4ae9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:33.550379 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-27fe8ac8-208c-4536-9f8a-fb06f0ae4ae9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.168359 Nov 24 15:24:33.551017 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 292/615] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:33 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:33.624743 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0a1ee82f-9618-48fc-b2ae-449066143d8a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:33.632438 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0a1ee82f-9618-48fc-b2ae-449066143d8a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:33.633947 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0a1ee82f-9618-48fc-b2ae-449066143d8a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:33.635125 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0a1ee82f-9618-48fc-b2ae-449066143d8a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1663 microversion: 2.20 time: 0.163095 Nov 24 15:24:33.635683 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 324/616] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:33 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1663 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:33.653380 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ff825d0c-7f8f-40ee-a51d-e9c2e5be1d32 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffb093c9-bc97-452a-95bb-2ba6cf74cba4"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:33.654435 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ff825d0c-7f8f-40ee-a51d-e9c2e5be1d32 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:33.660912 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff825d0c-7f8f-40ee-a51d-e9c2e5be1d32 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:33.661361 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff825d0c-7f8f-40ee-a51d-e9c2e5be1d32 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:33.662168 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff825d0c-7f8f-40ee-a51d-e9c2e5be1d32 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:33.662607 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff825d0c-7f8f-40ee-a51d-e9c2e5be1d32 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:33.757729 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b92b3e39-661f-4ed6-a932-2c3937dea4f2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:33.758719 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b92b3e39-661f-4ed6-a932-2c3937dea4f2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:33.765875 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b92b3e39-661f-4ed6-a932-2c3937dea4f2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:33.766404 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b92b3e39-661f-4ed6-a932-2c3937dea4f2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:33.767297 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b92b3e39-661f-4ed6-a932-2c3937dea4f2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:33.767804 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b92b3e39-661f-4ed6-a932-2c3937dea4f2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:33.840481 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b92b3e39-661f-4ed6-a932-2c3937dea4f2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 23228 microversion: 2.1 time: 0.086068 Nov 24 15:24:33.841570 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 325/617] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:33 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 23228 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:24:33.930397 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ff825d0c-7f8f-40ee-a51d-e9c2e5be1d32 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.280137 Nov 24 15:24:33.931438 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 293/618] 10.222.0.66 () {62 vars in 1363 bytes} [Wed Nov 24 15:24:33 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/os-volume_attachments => generated 188 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:24:34.039673 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-91435618-0391-494a-8b22-718fa49b11a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:34.040328 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-91435618-0391-494a-8b22-718fa49b11a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:34.047718 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-91435618-0391-494a-8b22-718fa49b11a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:34.048168 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-91435618-0391-494a-8b22-718fa49b11a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:34.049081 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-91435618-0391-494a-8b22-718fa49b11a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:34.049519 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-91435618-0391-494a-8b22-718fa49b11a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:34.143645 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-91435618-0391-494a-8b22-718fa49b11a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action" status: 202 len: 0 microversion: 2.20 time: 0.107860 Nov 24 15:24:34.144267 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 326/619] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:24:34 2021] POST /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:24:34.152419 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-34383ffc-be03-4b47-8bc9-7e2becbfe31e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:34.153467 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-34383ffc-be03-4b47-8bc9-7e2becbfe31e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:34.160663 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-34383ffc-be03-4b47-8bc9-7e2becbfe31e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:34.161275 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-34383ffc-be03-4b47-8bc9-7e2becbfe31e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:34.162206 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-34383ffc-be03-4b47-8bc9-7e2becbfe31e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:34.162749 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-34383ffc-be03-4b47-8bc9-7e2becbfe31e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:34.219294 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-e34eb059-0df3-4b27-8ee4-4c6f85938d3c req-d233cdc2-0739-46cf-bae3-85fbb2fee23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361e1e6c-853b-4fde-89ed-843a85be79c1", "name": "network-vif-unplugged", "status": "completed", "tag": "66d6070e-c6fb-4ac7-8705-204f502bc368"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:34.221834 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:24:34.221834 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:24:34.236204 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-e34eb059-0df3-4b27-8ee4-4c6f85938d3c req-d233cdc2-0739-46cf-bae3-85fbb2fee23e service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:34.236863 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-e34eb059-0df3-4b27-8ee4-4c6f85938d3c req-d233cdc2-0739-46cf-bae3-85fbb2fee23e service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:34.250472 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.compute.server_external_events [req-e34eb059-0df3-4b27-8ee4-4c6f85938d3c req-d233cdc2-0739-46cf-bae3-85fbb2fee23e service nova] Unable to find a host for instance 361e1e6c-853b-4fde-89ed-843a85be79c1. Dropping event network-vif-unplugged {{(pid=116072) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 24 15:24:34.251766 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-e34eb059-0df3-4b27-8ee4-4c6f85938d3c req-d233cdc2-0739-46cf-bae3-85fbb2fee23e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038059 Nov 24 15:24:34.252569 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 327/620] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:24:34 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 24 15:24:34.317817 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-34383ffc-be03-4b47-8bc9-7e2becbfe31e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:34.326062 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-34383ffc-be03-4b47-8bc9-7e2becbfe31e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:34.328127 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-34383ffc-be03-4b47-8bc9-7e2becbfe31e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:34.329287 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-34383ffc-be03-4b47-8bc9-7e2becbfe31e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1749 microversion: 2.20 time: 0.180764 Nov 24 15:24:34.329855 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 294/621] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:34 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1749 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:34.568049 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0f39d4b8-8b9b-4e1b-bdca-df84a7d50cd4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:34.568656 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0f39d4b8-8b9b-4e1b-bdca-df84a7d50cd4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:34.574954 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0f39d4b8-8b9b-4e1b-bdca-df84a7d50cd4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:34.575396 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0f39d4b8-8b9b-4e1b-bdca-df84a7d50cd4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:34.576183 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0f39d4b8-8b9b-4e1b-bdca-df84a7d50cd4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:34.576641 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0f39d4b8-8b9b-4e1b-bdca-df84a7d50cd4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:34.715722 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0f39d4b8-8b9b-4e1b-bdca-df84a7d50cd4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:34.723283 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0f39d4b8-8b9b-4e1b-bdca-df84a7d50cd4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.159000 Nov 24 15:24:34.725185 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 328/622] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:34 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:34.851932 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-9efb414e-8475-4520-bc3d-a91cd74db5dd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:34.852920 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-9efb414e-8475-4520-bc3d-a91cd74db5dd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:34.859481 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9efb414e-8475-4520-bc3d-a91cd74db5dd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:34.859926 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9efb414e-8475-4520-bc3d-a91cd74db5dd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:34.860705 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9efb414e-8475-4520-bc3d-a91cd74db5dd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:34.861136 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9efb414e-8475-4520-bc3d-a91cd74db5dd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:34.928865 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-9efb414e-8475-4520-bc3d-a91cd74db5dd tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 24556 microversion: 2.1 time: 0.080235 Nov 24 15:24:34.929758 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 295/623] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:34 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 24556 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:24:35.347184 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-51b8a7cf-5f63-47ae-b63d-5b3f6021b6ef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:35.347790 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-51b8a7cf-5f63-47ae-b63d-5b3f6021b6ef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:35.353975 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-51b8a7cf-5f63-47ae-b63d-5b3f6021b6ef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:35.354429 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-51b8a7cf-5f63-47ae-b63d-5b3f6021b6ef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:35.355233 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-51b8a7cf-5f63-47ae-b63d-5b3f6021b6ef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:35.355671 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-51b8a7cf-5f63-47ae-b63d-5b3f6021b6ef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:35.487457 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-51b8a7cf-5f63-47ae-b63d-5b3f6021b6ef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:35.496515 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-51b8a7cf-5f63-47ae-b63d-5b3f6021b6ef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:35.497994 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-51b8a7cf-5f63-47ae-b63d-5b3f6021b6ef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:35.499247 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-51b8a7cf-5f63-47ae-b63d-5b3f6021b6ef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1751 microversion: 2.20 time: 0.155650 Nov 24 15:24:35.499815 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 329/624] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:35 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1751 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:35.742031 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ce30cf69-e874-46b4-b032-604c93482124 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:35.742851 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ce30cf69-e874-46b4-b032-604c93482124 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:35.750441 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ce30cf69-e874-46b4-b032-604c93482124 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:35.751008 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ce30cf69-e874-46b4-b032-604c93482124 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:35.752023 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ce30cf69-e874-46b4-b032-604c93482124 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:35.752457 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ce30cf69-e874-46b4-b032-604c93482124 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:35.891901 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ce30cf69-e874-46b4-b032-604c93482124 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:35.899201 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ce30cf69-e874-46b4-b032-604c93482124 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.161433 Nov 24 15:24:35.899765 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 296/625] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:35 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:36.045203 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-74e1ca7d-eb3d-417f-9fbe-d2bf64150d48 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:36.046165 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-74e1ca7d-eb3d-417f-9fbe-d2bf64150d48 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:36.053192 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74e1ca7d-eb3d-417f-9fbe-d2bf64150d48 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:36.053645 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74e1ca7d-eb3d-417f-9fbe-d2bf64150d48 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:36.054431 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74e1ca7d-eb3d-417f-9fbe-d2bf64150d48 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:36.054899 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-74e1ca7d-eb3d-417f-9fbe-d2bf64150d48 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:36.130108 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-74e1ca7d-eb3d-417f-9fbe-d2bf64150d48 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 26254 microversion: 2.1 time: 0.192842 Nov 24 15:24:36.130857 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 330/626] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:35 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 26254 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:24:36.517671 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-884c1baf-525a-46ba-add5-f38a17c3fb38 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:36.518281 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-884c1baf-525a-46ba-add5-f38a17c3fb38 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:36.524609 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-884c1baf-525a-46ba-add5-f38a17c3fb38 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:36.525059 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-884c1baf-525a-46ba-add5-f38a17c3fb38 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:36.525840 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-884c1baf-525a-46ba-add5-f38a17c3fb38 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:36.526310 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-884c1baf-525a-46ba-add5-f38a17c3fb38 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:36.665462 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-884c1baf-525a-46ba-add5-f38a17c3fb38 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:36.675658 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-884c1baf-525a-46ba-add5-f38a17c3fb38 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:36.677166 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-884c1baf-525a-46ba-add5-f38a17c3fb38 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:36.678353 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-884c1baf-525a-46ba-add5-f38a17c3fb38 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.164468 Nov 24 15:24:36.678942 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 297/627] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:36 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:36.916759 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-436276c0-47ab-4897-8890-611aa932e444 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:36.917448 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-436276c0-47ab-4897-8890-611aa932e444 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:36.925087 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-436276c0-47ab-4897-8890-611aa932e444 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:36.925530 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-436276c0-47ab-4897-8890-611aa932e444 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:36.926307 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-436276c0-47ab-4897-8890-611aa932e444 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:36.926735 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-436276c0-47ab-4897-8890-611aa932e444 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:37.065386 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-436276c0-47ab-4897-8890-611aa932e444 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:37.073028 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-436276c0-47ab-4897-8890-611aa932e444 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.160314 Nov 24 15:24:37.073660 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 331/628] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:36 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:37.141425 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-bd10533e-f7a4-4b78-8c00-f50a782434da tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:37.142420 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-bd10533e-f7a4-4b78-8c00-f50a782434da tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:37.149358 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bd10533e-f7a4-4b78-8c00-f50a782434da tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:37.149812 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bd10533e-f7a4-4b78-8c00-f50a782434da tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:37.150590 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bd10533e-f7a4-4b78-8c00-f50a782434da tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:37.151054 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bd10533e-f7a4-4b78-8c00-f50a782434da tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:37.697704 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-53da732d-c734-4298-9966-88cf0cb7d5a7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:37.698311 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-53da732d-c734-4298-9966-88cf0cb7d5a7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:37.705637 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53da732d-c734-4298-9966-88cf0cb7d5a7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:37.706092 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53da732d-c734-4298-9966-88cf0cb7d5a7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:37.706922 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53da732d-c734-4298-9966-88cf0cb7d5a7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:37.707358 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53da732d-c734-4298-9966-88cf0cb7d5a7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:37.842755 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-53da732d-c734-4298-9966-88cf0cb7d5a7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:37.852393 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-53da732d-c734-4298-9966-88cf0cb7d5a7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:37.859492 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-53da732d-c734-4298-9966-88cf0cb7d5a7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:37.860721 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-53da732d-c734-4298-9966-88cf0cb7d5a7 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.166706 Nov 24 15:24:37.861280 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 332/629] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:37 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:38.090031 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-12267dcf-09e0-4d3d-adde-ae38c7a63324 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:38.090746 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-12267dcf-09e0-4d3d-adde-ae38c7a63324 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:38.097562 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-12267dcf-09e0-4d3d-adde-ae38c7a63324 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:38.098266 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-12267dcf-09e0-4d3d-adde-ae38c7a63324 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:38.099243 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-12267dcf-09e0-4d3d-adde-ae38c7a63324 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:38.099849 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-12267dcf-09e0-4d3d-adde-ae38c7a63324 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:38.243579 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-12267dcf-09e0-4d3d-adde-ae38c7a63324 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:38.251876 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-12267dcf-09e0-4d3d-adde-ae38c7a63324 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.165478 Nov 24 15:24:38.252672 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 333/630] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:38 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:24:38.879991 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1a725301-b3c4-4b01-9a0d-6873004097df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:38.880602 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1a725301-b3c4-4b01-9a0d-6873004097df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:38.888325 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1a725301-b3c4-4b01-9a0d-6873004097df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:38.888776 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1a725301-b3c4-4b01-9a0d-6873004097df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:38.890152 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1a725301-b3c4-4b01-9a0d-6873004097df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:38.890591 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1a725301-b3c4-4b01-9a0d-6873004097df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:39.031619 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1a725301-b3c4-4b01-9a0d-6873004097df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:39.040395 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1a725301-b3c4-4b01-9a0d-6873004097df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:39.041887 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1a725301-b3c4-4b01-9a0d-6873004097df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:39.043269 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1a725301-b3c4-4b01-9a0d-6873004097df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.166925 Nov 24 15:24:39.048667 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 334/631] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:38 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:39.269854 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7ecaf5b9-09d2-44e2-8ba8-5d1e4ece5a04 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:39.271420 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7ecaf5b9-09d2-44e2-8ba8-5d1e4ece5a04 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:39.277853 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7ecaf5b9-09d2-44e2-8ba8-5d1e4ece5a04 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:39.278389 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7ecaf5b9-09d2-44e2-8ba8-5d1e4ece5a04 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:39.279295 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7ecaf5b9-09d2-44e2-8ba8-5d1e4ece5a04 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:39.279728 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7ecaf5b9-09d2-44e2-8ba8-5d1e4ece5a04 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:39.413112 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7ecaf5b9-09d2-44e2-8ba8-5d1e4ece5a04 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:39.422048 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7ecaf5b9-09d2-44e2-8ba8-5d1e4ece5a04 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.156335 Nov 24 15:24:39.431595 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 335/632] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:39 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:24:40.061206 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ae473e0a-1b5e-42bb-87a6-b596ecce7897 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:40.061812 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ae473e0a-1b5e-42bb-87a6-b596ecce7897 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:40.068238 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae473e0a-1b5e-42bb-87a6-b596ecce7897 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:40.068696 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae473e0a-1b5e-42bb-87a6-b596ecce7897 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:40.069488 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae473e0a-1b5e-42bb-87a6-b596ecce7897 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:40.069923 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae473e0a-1b5e-42bb-87a6-b596ecce7897 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:40.428735 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ae473e0a-1b5e-42bb-87a6-b596ecce7897 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:40.437619 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ae473e0a-1b5e-42bb-87a6-b596ecce7897 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:40.439183 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ae473e0a-1b5e-42bb-87a6-b596ecce7897 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:40.440368 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ae473e0a-1b5e-42bb-87a6-b596ecce7897 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.382842 Nov 24 15:24:40.440954 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 336/633] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:40 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:40.445854 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2508a31b-2b7d-4373-ad22-c416bc6acc68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:40.446463 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2508a31b-2b7d-4373-ad22-c416bc6acc68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:40.464546 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2508a31b-2b7d-4373-ad22-c416bc6acc68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:40.465211 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2508a31b-2b7d-4373-ad22-c416bc6acc68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:40.466226 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2508a31b-2b7d-4373-ad22-c416bc6acc68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:40.467274 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2508a31b-2b7d-4373-ad22-c416bc6acc68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:40.603000 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2508a31b-2b7d-4373-ad22-c416bc6acc68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:40.610773 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2508a31b-2b7d-4373-ad22-c416bc6acc68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.168397 Nov 24 15:24:40.612013 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 337/634] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:40 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:41.458654 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-45d403b2-c106-4cc3-a1cb-5a22a807a3f8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:41.459334 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-45d403b2-c106-4cc3-a1cb-5a22a807a3f8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:41.465742 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45d403b2-c106-4cc3-a1cb-5a22a807a3f8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:41.466193 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45d403b2-c106-4cc3-a1cb-5a22a807a3f8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:41.467009 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45d403b2-c106-4cc3-a1cb-5a22a807a3f8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:41.467450 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45d403b2-c106-4cc3-a1cb-5a22a807a3f8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:41.602379 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-45d403b2-c106-4cc3-a1cb-5a22a807a3f8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:41.611079 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-45d403b2-c106-4cc3-a1cb-5a22a807a3f8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:41.613274 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-45d403b2-c106-4cc3-a1cb-5a22a807a3f8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:41.614698 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-45d403b2-c106-4cc3-a1cb-5a22a807a3f8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.159839 Nov 24 15:24:41.615339 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 338/635] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:41 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:41.628743 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-37b613e1-6f40-47a3-a105-e74805c1cdca tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:41.629338 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-37b613e1-6f40-47a3-a105-e74805c1cdca tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:41.635185 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-37b613e1-6f40-47a3-a105-e74805c1cdca tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:41.635633 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-37b613e1-6f40-47a3-a105-e74805c1cdca tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:41.636394 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-37b613e1-6f40-47a3-a105-e74805c1cdca tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:41.636820 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-37b613e1-6f40-47a3-a105-e74805c1cdca tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:41.774703 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-37b613e1-6f40-47a3-a105-e74805c1cdca tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:41.784151 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-37b613e1-6f40-47a3-a105-e74805c1cdca tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.159443 Nov 24 15:24:41.785334 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 339/636] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:41 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:24:42.633306 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b59cca24-4320-4952-927d-f4cfc0f96624 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:42.633994 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b59cca24-4320-4952-927d-f4cfc0f96624 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:42.640169 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b59cca24-4320-4952-927d-f4cfc0f96624 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:42.640616 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b59cca24-4320-4952-927d-f4cfc0f96624 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:42.641389 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b59cca24-4320-4952-927d-f4cfc0f96624 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:42.641824 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b59cca24-4320-4952-927d-f4cfc0f96624 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:42.778370 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b59cca24-4320-4952-927d-f4cfc0f96624 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:42.787820 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b59cca24-4320-4952-927d-f4cfc0f96624 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:42.789533 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b59cca24-4320-4952-927d-f4cfc0f96624 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:42.790717 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b59cca24-4320-4952-927d-f4cfc0f96624 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.161182 Nov 24 15:24:42.791505 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 340/637] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:42 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:42.801596 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0d6838a2-d7fa-4073-ae2b-b498a49e071e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:42.802503 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0d6838a2-d7fa-4073-ae2b-b498a49e071e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:42.808505 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d6838a2-d7fa-4073-ae2b-b498a49e071e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:42.808953 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d6838a2-d7fa-4073-ae2b-b498a49e071e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:42.809729 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d6838a2-d7fa-4073-ae2b-b498a49e071e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:42.810160 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d6838a2-d7fa-4073-ae2b-b498a49e071e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:42.950141 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0d6838a2-d7fa-4073-ae2b-b498a49e071e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:42.957441 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0d6838a2-d7fa-4073-ae2b-b498a49e071e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.159929 Nov 24 15:24:42.958013 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 341/638] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:42 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:24:43.808878 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fe425acb-c380-4612-8911-761663b2edb4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:43.809636 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fe425acb-c380-4612-8911-761663b2edb4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:43.815768 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fe425acb-c380-4612-8911-761663b2edb4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:43.816212 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fe425acb-c380-4612-8911-761663b2edb4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:43.816981 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fe425acb-c380-4612-8911-761663b2edb4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:43.817410 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fe425acb-c380-4612-8911-761663b2edb4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:43.974101 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fe425acb-c380-4612-8911-761663b2edb4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:43.982260 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fe425acb-c380-4612-8911-761663b2edb4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:43.983784 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fe425acb-c380-4612-8911-761663b2edb4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:43.984929 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fe425acb-c380-4612-8911-761663b2edb4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.179760 Nov 24 15:24:43.985488 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 342/639] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:43 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:43.989860 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4458a9e2-7ab6-42d6-af70-fd34b33fadc5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:43.990629 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4458a9e2-7ab6-42d6-af70-fd34b33fadc5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:43.996466 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4458a9e2-7ab6-42d6-af70-fd34b33fadc5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:43.996915 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4458a9e2-7ab6-42d6-af70-fd34b33fadc5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:43.997707 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4458a9e2-7ab6-42d6-af70-fd34b33fadc5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:43.998140 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4458a9e2-7ab6-42d6-af70-fd34b33fadc5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:44.143118 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4458a9e2-7ab6-42d6-af70-fd34b33fadc5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:44.150586 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4458a9e2-7ab6-42d6-af70-fd34b33fadc5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.164094 Nov 24 15:24:44.151320 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 343/640] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:43 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:44.279294 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-918664a7-4c7e-4bed-b444-798aa084557e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:44.279817 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-918664a7-4c7e-4bed-b444-798aa084557e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:44.286003 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-918664a7-4c7e-4bed-b444-798aa084557e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:44.286447 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-918664a7-4c7e-4bed-b444-798aa084557e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:44.287262 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-918664a7-4c7e-4bed-b444-798aa084557e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:44.287687 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-918664a7-4c7e-4bed-b444-798aa084557e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:44.313343 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-918664a7-4c7e-4bed-b444-798aa084557e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lazy-loading 'flavor' on Instance uuid b97e7745-6b55-46b5-a651-17bc3a3bdbc9 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:24:44.387311 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-918664a7-4c7e-4bed-b444-798aa084557e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "POST /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9/action" status: 202 len: 0 microversion: 2.1 time: 0.111355 Nov 24 15:24:44.391610 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 344/641] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:44 2021] POST /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 15:24:44.396908 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cc1e1d77-a82f-45db-a2e9-c2c3c1123f89 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:44.397565 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cc1e1d77-a82f-45db-a2e9-c2c3c1123f89 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:44.404311 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc1e1d77-a82f-45db-a2e9-c2c3c1123f89 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:44.404755 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc1e1d77-a82f-45db-a2e9-c2c3c1123f89 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:44.405536 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc1e1d77-a82f-45db-a2e9-c2c3c1123f89 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:44.405980 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cc1e1d77-a82f-45db-a2e9-c2c3c1123f89 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:44.560920 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cc1e1d77-a82f-45db-a2e9-c2c3c1123f89 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:44.569007 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cc1e1d77-a82f-45db-a2e9-c2c3c1123f89 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.176168 Nov 24 15:24:44.569574 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 345/642] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:44 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:45.005287 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-73815784-edad-419e-83ab-ca844ab36dc2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:45.005986 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-73815784-edad-419e-83ab-ca844ab36dc2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:45.013552 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-73815784-edad-419e-83ab-ca844ab36dc2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:45.013999 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-73815784-edad-419e-83ab-ca844ab36dc2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:45.014781 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-73815784-edad-419e-83ab-ca844ab36dc2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:45.015246 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-73815784-edad-419e-83ab-ca844ab36dc2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:45.159810 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-73815784-edad-419e-83ab-ca844ab36dc2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:45.169431 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-73815784-edad-419e-83ab-ca844ab36dc2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:45.171399 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-73815784-edad-419e-83ab-ca844ab36dc2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:45.172636 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-73815784-edad-419e-83ab-ca844ab36dc2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.171066 Nov 24 15:24:45.173281 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 346/643] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:45 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:45.177855 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a157314c-7ee5-41dd-9604-f348fcf3041b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:45.178535 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a157314c-7ee5-41dd-9604-f348fcf3041b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:45.185379 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a157314c-7ee5-41dd-9604-f348fcf3041b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:45.185933 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a157314c-7ee5-41dd-9604-f348fcf3041b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:45.186864 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a157314c-7ee5-41dd-9604-f348fcf3041b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:45.187370 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a157314c-7ee5-41dd-9604-f348fcf3041b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:45.334221 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a157314c-7ee5-41dd-9604-f348fcf3041b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:45.342207 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a157314c-7ee5-41dd-9604-f348fcf3041b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.167824 Nov 24 15:24:45.342783 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 347/644] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:45 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:45.585836 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-23857689-0e83-45d0-b460-6f02902bf598 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:45.586344 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-23857689-0e83-45d0-b460-6f02902bf598 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:45.592764 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-23857689-0e83-45d0-b460-6f02902bf598 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:45.593487 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-23857689-0e83-45d0-b460-6f02902bf598 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:45.594278 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-23857689-0e83-45d0-b460-6f02902bf598 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:45.594711 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-23857689-0e83-45d0-b460-6f02902bf598 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:45.729547 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-23857689-0e83-45d0-b460-6f02902bf598 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:45.737052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-23857689-0e83-45d0-b460-6f02902bf598 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.154925 Nov 24 15:24:45.737623 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 348/645] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:45 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:24:46.191815 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4eb9dc28-9845-4912-b2f7-8fffc5b921d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:46.192489 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4eb9dc28-9845-4912-b2f7-8fffc5b921d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:46.198743 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4eb9dc28-9845-4912-b2f7-8fffc5b921d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:46.199216 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4eb9dc28-9845-4912-b2f7-8fffc5b921d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:46.199994 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4eb9dc28-9845-4912-b2f7-8fffc5b921d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:46.200419 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4eb9dc28-9845-4912-b2f7-8fffc5b921d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:46.341234 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4eb9dc28-9845-4912-b2f7-8fffc5b921d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:46.349485 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4eb9dc28-9845-4912-b2f7-8fffc5b921d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:46.351208 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4eb9dc28-9845-4912-b2f7-8fffc5b921d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:46.352550 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4eb9dc28-9845-4912-b2f7-8fffc5b921d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.165493 Nov 24 15:24:46.353119 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 349/646] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:46 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:46.368596 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-842571a8-f4c1-4984-aa4a-178e9c618b96 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:46.369348 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-842571a8-f4c1-4984-aa4a-178e9c618b96 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:46.375373 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-842571a8-f4c1-4984-aa4a-178e9c618b96 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:46.375809 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-842571a8-f4c1-4984-aa4a-178e9c618b96 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:46.376592 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-842571a8-f4c1-4984-aa4a-178e9c618b96 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:46.377673 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-842571a8-f4c1-4984-aa4a-178e9c618b96 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:46.512184 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-842571a8-f4c1-4984-aa4a-178e9c618b96 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:46.519393 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-842571a8-f4c1-4984-aa4a-178e9c618b96 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.154509 Nov 24 15:24:46.519953 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 350/647] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:46 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:46.756010 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4c8915e9-1341-47dc-9b3a-eeac350cdf91 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:46.756662 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4c8915e9-1341-47dc-9b3a-eeac350cdf91 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:46.762633 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c8915e9-1341-47dc-9b3a-eeac350cdf91 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:46.763120 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c8915e9-1341-47dc-9b3a-eeac350cdf91 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:46.763889 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c8915e9-1341-47dc-9b3a-eeac350cdf91 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:46.764323 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4c8915e9-1341-47dc-9b3a-eeac350cdf91 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:46.902235 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4c8915e9-1341-47dc-9b3a-eeac350cdf91 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:46.911642 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4c8915e9-1341-47dc-9b3a-eeac350cdf91 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.159553 Nov 24 15:24:46.913245 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 351/648] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:46 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:24:47.371056 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7e804955-8777-4394-af34-72acf43f28be tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:47.371843 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7e804955-8777-4394-af34-72acf43f28be tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:47.378610 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7e804955-8777-4394-af34-72acf43f28be tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:47.379099 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7e804955-8777-4394-af34-72acf43f28be tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:47.379898 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7e804955-8777-4394-af34-72acf43f28be tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:47.380330 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7e804955-8777-4394-af34-72acf43f28be tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:47.517180 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7e804955-8777-4394-af34-72acf43f28be tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:47.529017 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7e804955-8777-4394-af34-72acf43f28be tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:47.530833 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7e804955-8777-4394-af34-72acf43f28be tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:47.532012 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7e804955-8777-4394-af34-72acf43f28be tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.164672 Nov 24 15:24:47.532819 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 352/649] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:47 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:47.537165 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-45b8864d-ee69-48c6-a5f7-ca18eda93f74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:47.537763 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-45b8864d-ee69-48c6-a5f7-ca18eda93f74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:47.543820 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45b8864d-ee69-48c6-a5f7-ca18eda93f74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:47.544262 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45b8864d-ee69-48c6-a5f7-ca18eda93f74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:47.545032 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45b8864d-ee69-48c6-a5f7-ca18eda93f74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:47.545458 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45b8864d-ee69-48c6-a5f7-ca18eda93f74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:47.687709 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-45b8864d-ee69-48c6-a5f7-ca18eda93f74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:47.696015 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-45b8864d-ee69-48c6-a5f7-ca18eda93f74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.162066 Nov 24 15:24:47.696801 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 353/650] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:47 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:47.929083 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-881876ec-fc20-4482-9cfe-435955b311ba tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:47.930108 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-881876ec-fc20-4482-9cfe-435955b311ba tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:47.937800 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-881876ec-fc20-4482-9cfe-435955b311ba tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:47.938240 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-881876ec-fc20-4482-9cfe-435955b311ba tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:47.939078 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-881876ec-fc20-4482-9cfe-435955b311ba tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:47.940241 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-881876ec-fc20-4482-9cfe-435955b311ba tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:48.081713 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-881876ec-fc20-4482-9cfe-435955b311ba tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:48.091196 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-881876ec-fc20-4482-9cfe-435955b311ba tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.165762 Nov 24 15:24:48.091960 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 354/651] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:47 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:24:48.550363 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3a93d30e-6295-4780-8eeb-9436e721a45f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:48.551076 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3a93d30e-6295-4780-8eeb-9436e721a45f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:48.557295 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a93d30e-6295-4780-8eeb-9436e721a45f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:48.557740 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a93d30e-6295-4780-8eeb-9436e721a45f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:48.558511 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a93d30e-6295-4780-8eeb-9436e721a45f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:48.558973 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a93d30e-6295-4780-8eeb-9436e721a45f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:48.687006 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3a93d30e-6295-4780-8eeb-9436e721a45f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:48.695794 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3a93d30e-6295-4780-8eeb-9436e721a45f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:48.697273 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3a93d30e-6295-4780-8eeb-9436e721a45f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:48.698415 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3a93d30e-6295-4780-8eeb-9436e721a45f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.151802 Nov 24 15:24:48.699022 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 355/652] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:48 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:48.712222 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-05a516ba-2f2d-431b-8d49-2675ddcb63fb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:48.712821 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-05a516ba-2f2d-431b-8d49-2675ddcb63fb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:48.718516 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-05a516ba-2f2d-431b-8d49-2675ddcb63fb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:48.719001 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-05a516ba-2f2d-431b-8d49-2675ddcb63fb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:48.719767 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-05a516ba-2f2d-431b-8d49-2675ddcb63fb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:48.720214 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-05a516ba-2f2d-431b-8d49-2675ddcb63fb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:48.852335 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-05a516ba-2f2d-431b-8d49-2675ddcb63fb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:48.860282 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-05a516ba-2f2d-431b-8d49-2675ddcb63fb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.151358 Nov 24 15:24:48.860855 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 356/653] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:48 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:24:48.918391 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-bd10533e-f7a4-4b78-8c00-f50a782434da tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 33568 microversion: 2.1 time: 11.780531 Nov 24 15:24:48.919325 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 298/654] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:37 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 33568 bytes in 11782 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:24:49.108872 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-23091bd8-b80c-4c91-96a6-756a7cfaf6a0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:49.109488 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-23091bd8-b80c-4c91-96a6-756a7cfaf6a0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:49.116868 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-23091bd8-b80c-4c91-96a6-756a7cfaf6a0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:49.117481 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-23091bd8-b80c-4c91-96a6-756a7cfaf6a0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:49.118370 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-23091bd8-b80c-4c91-96a6-756a7cfaf6a0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:49.119556 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-23091bd8-b80c-4c91-96a6-756a7cfaf6a0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:49.256465 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-23091bd8-b80c-4c91-96a6-756a7cfaf6a0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:49.264102 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-23091bd8-b80c-4c91-96a6-756a7cfaf6a0 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.158901 Nov 24 15:24:49.264882 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 357/655] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:49 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:49.716711 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-9603346f-a9cb-4e2b-9450-85a33f36fabb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:49.717320 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-9603346f-a9cb-4e2b-9450-85a33f36fabb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:49.724137 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9603346f-a9cb-4e2b-9450-85a33f36fabb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:49.724615 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9603346f-a9cb-4e2b-9450-85a33f36fabb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:49.725398 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9603346f-a9cb-4e2b-9450-85a33f36fabb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:49.725847 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9603346f-a9cb-4e2b-9450-85a33f36fabb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:49.860141 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-9603346f-a9cb-4e2b-9450-85a33f36fabb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:49.870773 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-9603346f-a9cb-4e2b-9450-85a33f36fabb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:49.872600 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-9603346f-a9cb-4e2b-9450-85a33f36fabb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:49.873839 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-9603346f-a9cb-4e2b-9450-85a33f36fabb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.161285 Nov 24 15:24:49.874395 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 299/656] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:49 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:49.877520 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7e18ef44-48d3-46d5-95c3-f521a963af10 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:49.878127 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7e18ef44-48d3-46d5-95c3-f521a963af10 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:49.884669 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7e18ef44-48d3-46d5-95c3-f521a963af10 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:49.885111 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7e18ef44-48d3-46d5-95c3-f521a963af10 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:49.886035 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7e18ef44-48d3-46d5-95c3-f521a963af10 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:49.886464 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7e18ef44-48d3-46d5-95c3-f521a963af10 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:49.930947 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-46c04f68-f9ef-4aef-8ae6-cfdbc1a8c41e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:49.930947 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-46c04f68-f9ef-4aef-8ae6-cfdbc1a8c41e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:49.938554 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-46c04f68-f9ef-4aef-8ae6-cfdbc1a8c41e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:49.939968 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-46c04f68-f9ef-4aef-8ae6-cfdbc1a8c41e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:49.941334 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-46c04f68-f9ef-4aef-8ae6-cfdbc1a8c41e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:49.942063 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-46c04f68-f9ef-4aef-8ae6-cfdbc1a8c41e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:50.020048 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-46c04f68-f9ef-4aef-8ae6-cfdbc1a8c41e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 34252 microversion: 2.1 time: 0.093673 Nov 24 15:24:50.024286 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 300/657] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:49 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 34252 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:24:50.025034 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7e18ef44-48d3-46d5-95c3-f521a963af10 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:50.032275 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7e18ef44-48d3-46d5-95c3-f521a963af10 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.158826 Nov 24 15:24:50.032825 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 358/658] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:49 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:24:50.281849 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4f01b10d-1abf-4c7f-aa35-d200fae26851 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:50.282575 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4f01b10d-1abf-4c7f-aa35-d200fae26851 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:50.290284 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4f01b10d-1abf-4c7f-aa35-d200fae26851 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:50.290731 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4f01b10d-1abf-4c7f-aa35-d200fae26851 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:50.291534 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4f01b10d-1abf-4c7f-aa35-d200fae26851 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:50.291970 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4f01b10d-1abf-4c7f-aa35-d200fae26851 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:50.426697 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4f01b10d-1abf-4c7f-aa35-d200fae26851 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:50.434087 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4f01b10d-1abf-4c7f-aa35-d200fae26851 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.156291 Nov 24 15:24:50.434644 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 301/659] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:50 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:50.892985 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-df4a452e-e2b3-4efc-8bdc-955ade040f2c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:50.893563 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-df4a452e-e2b3-4efc-8bdc-955ade040f2c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:50.899807 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df4a452e-e2b3-4efc-8bdc-955ade040f2c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:50.900254 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df4a452e-e2b3-4efc-8bdc-955ade040f2c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:50.901027 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df4a452e-e2b3-4efc-8bdc-955ade040f2c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:50.901461 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df4a452e-e2b3-4efc-8bdc-955ade040f2c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:51.031760 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-1875c70a-821b-4422-a3dd-a10e91ea199e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:51.033330 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-1875c70a-821b-4422-a3dd-a10e91ea199e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:51.039428 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-df4a452e-e2b3-4efc-8bdc-955ade040f2c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:51.041902 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1875c70a-821b-4422-a3dd-a10e91ea199e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:51.042361 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1875c70a-821b-4422-a3dd-a10e91ea199e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:51.043306 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1875c70a-821b-4422-a3dd-a10e91ea199e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:51.043883 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1875c70a-821b-4422-a3dd-a10e91ea199e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:51.048034 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-df4a452e-e2b3-4efc-8bdc-955ade040f2c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:51.049692 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-df4a452e-e2b3-4efc-8bdc-955ade040f2c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:51.051106 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-df4a452e-e2b3-4efc-8bdc-955ade040f2c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.162233 Nov 24 15:24:51.051747 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 359/660] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:50 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:51.056120 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3de74582-7ff8-40b9-8fed-4ed58db1ec72 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:51.056717 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3de74582-7ff8-40b9-8fed-4ed58db1ec72 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:51.062437 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3de74582-7ff8-40b9-8fed-4ed58db1ec72 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:51.062921 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3de74582-7ff8-40b9-8fed-4ed58db1ec72 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:51.063822 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3de74582-7ff8-40b9-8fed-4ed58db1ec72 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:51.064712 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3de74582-7ff8-40b9-8fed-4ed58db1ec72 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:51.119370 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-1875c70a-821b-4422-a3dd-a10e91ea199e tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 35403 microversion: 2.1 time: 0.091134 Nov 24 15:24:51.120326 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 302/661] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:51 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 35403 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:24:51.196588 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3de74582-7ff8-40b9-8fed-4ed58db1ec72 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:51.203798 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3de74582-7ff8-40b9-8fed-4ed58db1ec72 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.151116 Nov 24 15:24:51.204361 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 360/662] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:51 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:51.451643 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-e85eb0e1-cb6e-4fde-8ef4-14b8ed7f2f17 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:51.452289 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-e85eb0e1-cb6e-4fde-8ef4-14b8ed7f2f17 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:51.459139 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e85eb0e1-cb6e-4fde-8ef4-14b8ed7f2f17 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:51.459586 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e85eb0e1-cb6e-4fde-8ef4-14b8ed7f2f17 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:51.460365 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e85eb0e1-cb6e-4fde-8ef4-14b8ed7f2f17 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:51.460805 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e85eb0e1-cb6e-4fde-8ef4-14b8ed7f2f17 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:51.596086 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e85eb0e1-cb6e-4fde-8ef4-14b8ed7f2f17 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:51.603441 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-e85eb0e1-cb6e-4fde-8ef4-14b8ed7f2f17 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.155867 Nov 24 15:24:51.603985 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 303/663] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:51 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:52.069320 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b9d97f5f-538a-4508-a957-1035ea50787d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:52.069905 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b9d97f5f-538a-4508-a957-1035ea50787d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:52.076221 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b9d97f5f-538a-4508-a957-1035ea50787d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:52.076667 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b9d97f5f-538a-4508-a957-1035ea50787d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:52.077440 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b9d97f5f-538a-4508-a957-1035ea50787d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:52.077872 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b9d97f5f-538a-4508-a957-1035ea50787d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:52.131010 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8475b532-f066-4794-b43d-7cb71e73a9ac tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:52.131920 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8475b532-f066-4794-b43d-7cb71e73a9ac tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:52.138676 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8475b532-f066-4794-b43d-7cb71e73a9ac tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:52.139151 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8475b532-f066-4794-b43d-7cb71e73a9ac tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:52.139931 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8475b532-f066-4794-b43d-7cb71e73a9ac tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:52.140366 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8475b532-f066-4794-b43d-7cb71e73a9ac tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:52.211992 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b9d97f5f-538a-4508-a957-1035ea50787d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:52.212806 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8475b532-f066-4794-b43d-7cb71e73a9ac tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 36850 microversion: 2.1 time: 0.084900 Nov 24 15:24:52.215016 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 304/664] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:52 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 36850 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 24 15:24:52.221796 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b9d97f5f-538a-4508-a957-1035ea50787d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:52.223304 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b9d97f5f-538a-4508-a957-1035ea50787d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:52.223544 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-16b6cc9f-b9e4-44c7-9a31-a798a42cb2e8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:52.224247 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-16b6cc9f-b9e4-44c7-9a31-a798a42cb2e8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:52.224564 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b9d97f5f-538a-4508-a957-1035ea50787d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.158941 Nov 24 15:24:52.225291 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 361/665] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:52 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:52.231376 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-16b6cc9f-b9e4-44c7-9a31-a798a42cb2e8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:52.231824 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-16b6cc9f-b9e4-44c7-9a31-a798a42cb2e8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:52.232614 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-16b6cc9f-b9e4-44c7-9a31-a798a42cb2e8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:52.233053 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-16b6cc9f-b9e4-44c7-9a31-a798a42cb2e8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:52.369568 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-16b6cc9f-b9e4-44c7-9a31-a798a42cb2e8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:52.376860 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-16b6cc9f-b9e4-44c7-9a31-a798a42cb2e8 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.159363 Nov 24 15:24:52.377608 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 305/666] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:52 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:52.621517 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fa2f3409-d61c-401b-8202-e307a920195e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:52.622118 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fa2f3409-d61c-401b-8202-e307a920195e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:52.628355 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa2f3409-d61c-401b-8202-e307a920195e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:52.628796 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa2f3409-d61c-401b-8202-e307a920195e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:52.629568 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa2f3409-d61c-401b-8202-e307a920195e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:52.629994 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fa2f3409-d61c-401b-8202-e307a920195e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:52.763879 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fa2f3409-d61c-401b-8202-e307a920195e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:52.771959 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fa2f3409-d61c-401b-8202-e307a920195e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.154135 Nov 24 15:24:52.772542 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 362/667] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:52 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:53.223481 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-eb43de99-4935-439c-ab4e-64e95d7dbb40 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:53.224390 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-eb43de99-4935-439c-ab4e-64e95d7dbb40 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:53.230727 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eb43de99-4935-439c-ab4e-64e95d7dbb40 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:53.231206 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eb43de99-4935-439c-ab4e-64e95d7dbb40 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:53.231982 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eb43de99-4935-439c-ab4e-64e95d7dbb40 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:53.232416 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eb43de99-4935-439c-ab4e-64e95d7dbb40 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:53.242938 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-53bc7364-8c20-4805-ab34-eb2754fbf43a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:53.243552 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-53bc7364-8c20-4805-ab34-eb2754fbf43a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:53.250019 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53bc7364-8c20-4805-ab34-eb2754fbf43a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:53.250505 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53bc7364-8c20-4805-ab34-eb2754fbf43a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:53.251325 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53bc7364-8c20-4805-ab34-eb2754fbf43a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:53.252353 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53bc7364-8c20-4805-ab34-eb2754fbf43a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:53.307521 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-eb43de99-4935-439c-ab4e-64e95d7dbb40 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 38179 microversion: 2.1 time: 0.087500 Nov 24 15:24:53.311876 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 306/668] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:53 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 38179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:24:53.381578 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-53bc7364-8c20-4805-ab34-eb2754fbf43a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:53.389798 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-53bc7364-8c20-4805-ab34-eb2754fbf43a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:53.391289 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-53bc7364-8c20-4805-ab34-eb2754fbf43a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:53.392432 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-53bc7364-8c20-4805-ab34-eb2754fbf43a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.153506 Nov 24 15:24:53.392976 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 363/669] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:53 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:53.394193 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b1785608-d9e3-483a-b3cc-2776fdccc837 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:53.394923 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b1785608-d9e3-483a-b3cc-2776fdccc837 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:53.402082 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b1785608-d9e3-483a-b3cc-2776fdccc837 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:53.402520 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b1785608-d9e3-483a-b3cc-2776fdccc837 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:53.403319 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b1785608-d9e3-483a-b3cc-2776fdccc837 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:53.403750 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b1785608-d9e3-483a-b3cc-2776fdccc837 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:53.537690 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-b1785608-d9e3-483a-b3cc-2776fdccc837 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:53.545040 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b1785608-d9e3-483a-b3cc-2776fdccc837 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.154854 Nov 24 15:24:53.545605 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 307/670] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:53 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:24:53.789439 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-82707507-919b-4723-a87c-41ea80f57ded tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:53.789956 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-82707507-919b-4723-a87c-41ea80f57ded tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:53.795798 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-82707507-919b-4723-a87c-41ea80f57ded tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:53.796245 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-82707507-919b-4723-a87c-41ea80f57ded tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:53.797040 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-82707507-919b-4723-a87c-41ea80f57ded tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:53.797468 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-82707507-919b-4723-a87c-41ea80f57ded tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:53.927809 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-82707507-919b-4723-a87c-41ea80f57ded tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:53.935422 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-82707507-919b-4723-a87c-41ea80f57ded tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.149636 Nov 24 15:24:53.935982 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 364/671] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:53 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:54.320303 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c1446d73-d45a-41fe-94ef-11c51f329bd8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:54.321151 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c1446d73-d45a-41fe-94ef-11c51f329bd8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:54.327392 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c1446d73-d45a-41fe-94ef-11c51f329bd8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:54.327833 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c1446d73-d45a-41fe-94ef-11c51f329bd8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:54.329015 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c1446d73-d45a-41fe-94ef-11c51f329bd8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:54.329015 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c1446d73-d45a-41fe-94ef-11c51f329bd8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:54.341062 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-cfb628e9-2d1c-4db4-a8b7-1064922bcf27 req-97c4d436-176e-4968-a74a-38cac031ce71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246791eb-b0eb-44f0-9417-f106580a57f5", "name": "network-vif-plugged", "status": "completed", "tag": "140a8110-eae9-4c4f-bc1c-8a0a2e8b5413"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:54.343481 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:24:54.343481 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:24:54.353011 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-cfb628e9-2d1c-4db4-a8b7-1064922bcf27 req-97c4d436-176e-4968-a74a-38cac031ce71 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:54.353669 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-cfb628e9-2d1c-4db4-a8b7-1064922bcf27 req-97c4d436-176e-4968-a74a-38cac031ce71 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:54.366617 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-cfb628e9-2d1c-4db4-a8b7-1064922bcf27 req-97c4d436-176e-4968-a74a-38cac031ce71 service nova] Creating event network-vif-plugged:140a8110-eae9-4c4f-bc1c-8a0a2e8b5413 for instance 246791eb-b0eb-44f0-9417-f106580a57f5 on hv-cinder-80403 Nov 24 15:24:54.371616 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-cfb628e9-2d1c-4db4-a8b7-1064922bcf27 req-97c4d436-176e-4968-a74a-38cac031ce71 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035142 Nov 24 15:24:54.372376 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 365/672] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:24:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:24:54.411525 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a720811c-d6ba-46a1-8abb-41e414ade2aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:54.411695 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c1446d73-d45a-41fe-94ef-11c51f329bd8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 38181 microversion: 2.1 time: 0.095016 Nov 24 15:24:54.412217 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a720811c-d6ba-46a1-8abb-41e414ade2aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:54.413431 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 308/673] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:54 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 38181 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:24:54.418423 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a720811c-d6ba-46a1-8abb-41e414ade2aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:54.418909 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a720811c-d6ba-46a1-8abb-41e414ade2aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:54.419687 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a720811c-d6ba-46a1-8abb-41e414ade2aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:54.420113 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a720811c-d6ba-46a1-8abb-41e414ade2aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:54.551423 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a720811c-d6ba-46a1-8abb-41e414ade2aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:54.560491 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a720811c-d6ba-46a1-8abb-41e414ade2aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:54.561986 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a720811c-d6ba-46a1-8abb-41e414ade2aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:54.562736 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-104edfbe-4abd-4238-b01e-65b6e3063197 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:54.563186 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a720811c-d6ba-46a1-8abb-41e414ade2aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.156166 Nov 24 15:24:54.563492 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-104edfbe-4abd-4238-b01e-65b6e3063197 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:54.563750 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 366/674] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:54 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:24:54.571463 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-104edfbe-4abd-4238-b01e-65b6e3063197 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:54.571924 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-104edfbe-4abd-4238-b01e-65b6e3063197 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:54.572698 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-104edfbe-4abd-4238-b01e-65b6e3063197 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:54.573139 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-104edfbe-4abd-4238-b01e-65b6e3063197 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:54.712217 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-104edfbe-4abd-4238-b01e-65b6e3063197 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:54.719476 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-104edfbe-4abd-4238-b01e-65b6e3063197 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.160683 Nov 24 15:24:54.720065 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 309/675] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:54 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:24:54.952425 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e2d6f816-24aa-4c5c-84ce-a8428355e1f1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:54.952941 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e2d6f816-24aa-4c5c-84ce-a8428355e1f1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:54.958691 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2d6f816-24aa-4c5c-84ce-a8428355e1f1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:54.959159 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2d6f816-24aa-4c5c-84ce-a8428355e1f1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:54.959915 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2d6f816-24aa-4c5c-84ce-a8428355e1f1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:54.960347 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2d6f816-24aa-4c5c-84ce-a8428355e1f1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:55.089899 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e2d6f816-24aa-4c5c-84ce-a8428355e1f1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:55.097751 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e2d6f816-24aa-4c5c-84ce-a8428355e1f1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.149084 Nov 24 15:24:55.098320 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 367/676] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:54 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:55.423521 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-93eca816-1a92-4115-b5d5-d451b2d4738f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:55.424455 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-93eca816-1a92-4115-b5d5-d451b2d4738f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:55.430759 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-93eca816-1a92-4115-b5d5-d451b2d4738f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:55.431240 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-93eca816-1a92-4115-b5d5-d451b2d4738f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:55.432008 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-93eca816-1a92-4115-b5d5-d451b2d4738f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:55.432439 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-93eca816-1a92-4115-b5d5-d451b2d4738f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:55.492533 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-93eca816-1a92-4115-b5d5-d451b2d4738f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 38181 microversion: 2.1 time: 0.072522 Nov 24 15:24:55.493461 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 310/677] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:55 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 38181 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:24:55.582420 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fcec31fa-d47b-4f3b-b409-a2f5a974ed95 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:55.583095 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fcec31fa-d47b-4f3b-b409-a2f5a974ed95 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:55.589396 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fcec31fa-d47b-4f3b-b409-a2f5a974ed95 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:55.589840 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fcec31fa-d47b-4f3b-b409-a2f5a974ed95 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:55.590603 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fcec31fa-d47b-4f3b-b409-a2f5a974ed95 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:55.591051 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fcec31fa-d47b-4f3b-b409-a2f5a974ed95 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:55.733345 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fcec31fa-d47b-4f3b-b409-a2f5a974ed95 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:55.736512 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-5537e17e-b469-4e06-aefb-6b3ec0f0d93a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:55.738047 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-5537e17e-b469-4e06-aefb-6b3ec0f0d93a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:55.745937 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5537e17e-b469-4e06-aefb-6b3ec0f0d93a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:55.746653 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5537e17e-b469-4e06-aefb-6b3ec0f0d93a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:55.747945 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5537e17e-b469-4e06-aefb-6b3ec0f0d93a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:55.748075 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fcec31fa-d47b-4f3b-b409-a2f5a974ed95 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:55.748839 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5537e17e-b469-4e06-aefb-6b3ec0f0d93a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:55.750654 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fcec31fa-d47b-4f3b-b409-a2f5a974ed95 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:55.753075 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fcec31fa-d47b-4f3b-b409-a2f5a974ed95 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.174920 Nov 24 15:24:55.756452 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 368/678] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:55 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:55.893684 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-5537e17e-b469-4e06-aefb-6b3ec0f0d93a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:55.900994 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-5537e17e-b469-4e06-aefb-6b3ec0f0d93a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1266 microversion: 2.1 time: 0.168788 Nov 24 15:24:55.901567 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 311/679] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:55 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:24:56.115578 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c8ff2040-8321-41b9-b856-34f6c35d914c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:56.116189 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c8ff2040-8321-41b9-b856-34f6c35d914c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:56.121974 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8ff2040-8321-41b9-b856-34f6c35d914c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:56.122501 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8ff2040-8321-41b9-b856-34f6c35d914c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:56.123296 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8ff2040-8321-41b9-b856-34f6c35d914c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:56.123725 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c8ff2040-8321-41b9-b856-34f6c35d914c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:56.263814 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c8ff2040-8321-41b9-b856-34f6c35d914c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:56.271223 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c8ff2040-8321-41b9-b856-34f6c35d914c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.159534 Nov 24 15:24:56.271795 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 369/680] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:56 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:56.504330 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-1ed71211-6b74-4c32-8f57-39858b421177 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:56.505250 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-1ed71211-6b74-4c32-8f57-39858b421177 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:56.511693 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1ed71211-6b74-4c32-8f57-39858b421177 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:56.512157 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1ed71211-6b74-4c32-8f57-39858b421177 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:56.512973 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1ed71211-6b74-4c32-8f57-39858b421177 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:56.513413 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1ed71211-6b74-4c32-8f57-39858b421177 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:56.575855 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-1ed71211-6b74-4c32-8f57-39858b421177 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 38181 microversion: 2.1 time: 0.075029 Nov 24 15:24:56.576776 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 312/681] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:56 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 38181 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:24:56.772101 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-aa37d92d-f688-4698-9c21-93d1bd14bb91 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:56.772879 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-aa37d92d-f688-4698-9c21-93d1bd14bb91 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:56.779068 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa37d92d-f688-4698-9c21-93d1bd14bb91 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:56.779507 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa37d92d-f688-4698-9c21-93d1bd14bb91 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:56.780290 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa37d92d-f688-4698-9c21-93d1bd14bb91 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:56.780736 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa37d92d-f688-4698-9c21-93d1bd14bb91 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:56.915380 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-aa37d92d-f688-4698-9c21-93d1bd14bb91 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:56.918069 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-acee5577-c339-4d34-8c5a-0214b57b4f2e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:56.918756 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-acee5577-c339-4d34-8c5a-0214b57b4f2e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:56.923634 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-aa37d92d-f688-4698-9c21-93d1bd14bb91 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:56.925143 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-aa37d92d-f688-4698-9c21-93d1bd14bb91 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:56.925536 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-acee5577-c339-4d34-8c5a-0214b57b4f2e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:56.925983 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-acee5577-c339-4d34-8c5a-0214b57b4f2e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:56.926292 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-aa37d92d-f688-4698-9c21-93d1bd14bb91 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.158014 Nov 24 15:24:56.926879 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 370/682] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:56 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:56.928013 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-acee5577-c339-4d34-8c5a-0214b57b4f2e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:56.928478 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-acee5577-c339-4d34-8c5a-0214b57b4f2e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:57.060605 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-acee5577-c339-4d34-8c5a-0214b57b4f2e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:57.068902 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-acee5577-c339-4d34-8c5a-0214b57b4f2e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1453 microversion: 2.1 time: 0.154808 Nov 24 15:24:57.069487 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 313/683] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:56 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:24:57.085033 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f0449506-198a-4271-8c3e-9201ba79bc80 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:57.085641 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f0449506-198a-4271-8c3e-9201ba79bc80 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:57.091447 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f0449506-198a-4271-8c3e-9201ba79bc80 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:57.091894 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f0449506-198a-4271-8c3e-9201ba79bc80 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:57.092669 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f0449506-198a-4271-8c3e-9201ba79bc80 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:57.093113 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f0449506-198a-4271-8c3e-9201ba79bc80 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:57.226128 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f0449506-198a-4271-8c3e-9201ba79bc80 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:57.233375 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f0449506-198a-4271-8c3e-9201ba79bc80 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1453 microversion: 2.1 time: 0.151906 Nov 24 15:24:57.233940 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 371/684] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:57 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:57.288176 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3dcf53c5-86ff-4841-bf92-d3dc3ab783d1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:57.289009 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3dcf53c5-86ff-4841-bf92-d3dc3ab783d1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:57.295349 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3dcf53c5-86ff-4841-bf92-d3dc3ab783d1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:57.295797 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3dcf53c5-86ff-4841-bf92-d3dc3ab783d1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:57.296582 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3dcf53c5-86ff-4841-bf92-d3dc3ab783d1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:57.297016 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3dcf53c5-86ff-4841-bf92-d3dc3ab783d1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:57.478785 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-3dcf53c5-86ff-4841-bf92-d3dc3ab783d1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:57.486680 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3dcf53c5-86ff-4841-bf92-d3dc3ab783d1 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.201738 Nov 24 15:24:57.487282 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 314/685] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:57 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:57.588065 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-81e4cdec-e33b-41b8-89cf-78d7a216f9d2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:57.589113 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-81e4cdec-e33b-41b8-89cf-78d7a216f9d2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:57.595898 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-81e4cdec-e33b-41b8-89cf-78d7a216f9d2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:57.596473 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-81e4cdec-e33b-41b8-89cf-78d7a216f9d2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:57.597541 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-81e4cdec-e33b-41b8-89cf-78d7a216f9d2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:57.598131 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-81e4cdec-e33b-41b8-89cf-78d7a216f9d2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:57.670915 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-81e4cdec-e33b-41b8-89cf-78d7a216f9d2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action" status: 200 len: 38310 microversion: 2.1 time: 0.086492 Nov 24 15:24:57.676759 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 372/686] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:24:57 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/action => generated 38310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:24:57.681689 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ad6dcc9f-0e62-43c2-913b-f86092fb4aa8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:57.682188 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ad6dcc9f-0e62-43c2-913b-f86092fb4aa8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:57.688340 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ad6dcc9f-0e62-43c2-913b-f86092fb4aa8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:57.688786 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ad6dcc9f-0e62-43c2-913b-f86092fb4aa8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:57.690171 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ad6dcc9f-0e62-43c2-913b-f86092fb4aa8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:57.690606 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ad6dcc9f-0e62-43c2-913b-f86092fb4aa8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:57.717964 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ad6dcc9f-0e62-43c2-913b-f86092fb4aa8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/ips" status: 200 len: 147 microversion: 2.1 time: 0.039835 Nov 24 15:24:57.724728 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 315/687] 10.222.0.66 () {58 vars in 1247 bytes} [Wed Nov 24 15:24:57 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/ips => generated 147 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:24:57.945593 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-512a6532-bd68-4f00-90cf-638592f8bc16 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:57.946281 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-512a6532-bd68-4f00-90cf-638592f8bc16 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:57.954138 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-512a6532-bd68-4f00-90cf-638592f8bc16 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:57.954138 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-512a6532-bd68-4f00-90cf-638592f8bc16 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:57.954891 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-512a6532-bd68-4f00-90cf-638592f8bc16 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:57.955326 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-512a6532-bd68-4f00-90cf-638592f8bc16 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:58.210454 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-512a6532-bd68-4f00-90cf-638592f8bc16 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:58.219891 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-512a6532-bd68-4f00-90cf-638592f8bc16 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:58.222286 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-512a6532-bd68-4f00-90cf-638592f8bc16 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:58.223926 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-512a6532-bd68-4f00-90cf-638592f8bc16 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.282819 Nov 24 15:24:58.224600 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 373/688] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:57 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:58.398442 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-48f05f57-76ec-4151-aae9-8e62cdeaf101 req-eeb54b5b-b7b2-455e-b560-cfb4c36149af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361e1e6c-853b-4fde-89ed-843a85be79c1", "name": "network-vif-plugged", "status": "completed", "tag": "66d6070e-c6fb-4ac7-8705-204f502bc368"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:58.400316 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:24:58.400316 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:24:58.409199 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-48f05f57-76ec-4151-aae9-8e62cdeaf101 req-eeb54b5b-b7b2-455e-b560-cfb4c36149af service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:58.409649 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-48f05f57-76ec-4151-aae9-8e62cdeaf101 req-eeb54b5b-b7b2-455e-b560-cfb4c36149af service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:58.422678 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-48f05f57-76ec-4151-aae9-8e62cdeaf101 req-eeb54b5b-b7b2-455e-b560-cfb4c36149af service nova] Creating event network-vif-plugged:66d6070e-c6fb-4ac7-8705-204f502bc368 for instance 361e1e6c-853b-4fde-89ed-843a85be79c1 on hv-cinder-80403 Nov 24 15:24:58.427914 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-48f05f57-76ec-4151-aae9-8e62cdeaf101 req-eeb54b5b-b7b2-455e-b560-cfb4c36149af service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033424 Nov 24 15:24:58.428749 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 316/689] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:24:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:24:58.504271 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-73c84a10-acf5-4ab7-ac50-029c1f0ca89c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:58.504870 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-73c84a10-acf5-4ab7-ac50-029c1f0ca89c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:58.511348 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-73c84a10-acf5-4ab7-ac50-029c1f0ca89c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:58.511793 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-73c84a10-acf5-4ab7-ac50-029c1f0ca89c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:58.512642 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-73c84a10-acf5-4ab7-ac50-029c1f0ca89c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:58.513054 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-73c84a10-acf5-4ab7-ac50-029c1f0ca89c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:58.767242 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-73c84a10-acf5-4ab7-ac50-029c1f0ca89c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:58.775824 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-73c84a10-acf5-4ab7-ac50-029c1f0ca89c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.275156 Nov 24 15:24:58.776400 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 374/690] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:58 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:24:59.052265 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-1022b6bc-8eac-4c27-b262-c95c3cf85a89 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6834e1a6-51de-41d5-9b99-12ce475f72a3"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:59.053490 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-1022b6bc-8eac-4c27-b262-c95c3cf85a89 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:59.060152 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1022b6bc-8eac-4c27-b262-c95c3cf85a89 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:59.060706 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1022b6bc-8eac-4c27-b262-c95c3cf85a89 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:59.061659 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1022b6bc-8eac-4c27-b262-c95c3cf85a89 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:59.062098 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1022b6bc-8eac-4c27-b262-c95c3cf85a89 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:59.175168 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-0ee9f623-50b0-4274-a116-e17bb43a6ded req-cfd1d066-808a-4147-83b4-473d512266ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246791eb-b0eb-44f0-9417-f106580a57f5", "tag": "140a8110-eae9-4c4f-bc1c-8a0a2e8b5413"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:24:59.176804 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:24:59.176804 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:24:59.184741 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-0ee9f623-50b0-4274-a116-e17bb43a6ded req-cfd1d066-808a-4147-83b4-473d512266ee service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:59.185193 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-0ee9f623-50b0-4274-a116-e17bb43a6ded req-cfd1d066-808a-4147-83b4-473d512266ee service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:59.197664 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-0ee9f623-50b0-4274-a116-e17bb43a6ded req-cfd1d066-808a-4147-83b4-473d512266ee service nova] Creating event network-changed:140a8110-eae9-4c4f-bc1c-8a0a2e8b5413 for instance 246791eb-b0eb-44f0-9417-f106580a57f5 on hv-cinder-80403 Nov 24 15:24:59.202915 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-0ee9f623-50b0-4274-a116-e17bb43a6ded req-cfd1d066-808a-4147-83b4-473d512266ee service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095465 Nov 24 15:24:59.203746 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 375/691] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:24:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:24:59.253146 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b1916400-0777-4ebc-bc7e-7aefd877a553 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:59.254194 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b1916400-0777-4ebc-bc7e-7aefd877a553 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:59.267367 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1916400-0777-4ebc-bc7e-7aefd877a553 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:59.268000 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1916400-0777-4ebc-bc7e-7aefd877a553 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:59.268964 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1916400-0777-4ebc-bc7e-7aefd877a553 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:59.269555 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1916400-0777-4ebc-bc7e-7aefd877a553 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:59.332641 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-1022b6bc-8eac-4c27-b262-c95c3cf85a89 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285418 Nov 24 15:24:59.333674 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 317/692] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Nov 24 15:24:59 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:24:59.661176 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b1916400-0777-4ebc-bc7e-7aefd877a553 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:59.671047 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b1916400-0777-4ebc-bc7e-7aefd877a553 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:59.672535 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b1916400-0777-4ebc-bc7e-7aefd877a553 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:59.673871 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b1916400-0777-4ebc-bc7e-7aefd877a553 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1807 microversion: 2.20 time: 0.435691 Nov 24 15:24:59.684613 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 376/693] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:24:59 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1807 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:24:59.794535 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-62c74e91-5733-4f86-a68a-6fc0daef9a44 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:24:59.795361 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-62c74e91-5733-4f86-a68a-6fc0daef9a44 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:24:59.802328 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-62c74e91-5733-4f86-a68a-6fc0daef9a44 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:59.802772 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-62c74e91-5733-4f86-a68a-6fc0daef9a44 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:59.803780 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-62c74e91-5733-4f86-a68a-6fc0daef9a44 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:24:59.804384 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-62c74e91-5733-4f86-a68a-6fc0daef9a44 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:24:59.946458 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-62c74e91-5733-4f86-a68a-6fc0daef9a44 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:24:59.956994 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-62c74e91-5733-4f86-a68a-6fc0daef9a44 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.166949 Nov 24 15:24:59.957764 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 318/694] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:24:59 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:00.692538 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c0273796-2a37-4e45-9664-228dd9bd14c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:00.693244 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c0273796-2a37-4e45-9664-228dd9bd14c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:00.699922 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0273796-2a37-4e45-9664-228dd9bd14c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:00.700366 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0273796-2a37-4e45-9664-228dd9bd14c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:00.701135 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0273796-2a37-4e45-9664-228dd9bd14c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:00.701563 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c0273796-2a37-4e45-9664-228dd9bd14c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:00.829131 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c0273796-2a37-4e45-9664-228dd9bd14c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:00.837368 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c0273796-2a37-4e45-9664-228dd9bd14c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:00.838765 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c0273796-2a37-4e45-9664-228dd9bd14c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:00.839951 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c0273796-2a37-4e45-9664-228dd9bd14c9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1794 microversion: 2.20 time: 0.151758 Nov 24 15:25:00.840509 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 377/695] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:00 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1794 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:25:00.974645 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-754425fa-d8d5-4ed9-8b7d-c68991d51165 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:00.975283 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-754425fa-d8d5-4ed9-8b7d-c68991d51165 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:00.981703 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-754425fa-d8d5-4ed9-8b7d-c68991d51165 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:00.982160 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-754425fa-d8d5-4ed9-8b7d-c68991d51165 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:00.982977 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-754425fa-d8d5-4ed9-8b7d-c68991d51165 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:00.983421 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-754425fa-d8d5-4ed9-8b7d-c68991d51165 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:01.115219 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-754425fa-d8d5-4ed9-8b7d-c68991d51165 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:01.122553 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-754425fa-d8d5-4ed9-8b7d-c68991d51165 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.152078 Nov 24 15:25:01.123152 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 319/696] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:00 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:02.140121 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6e22aa6b-29d5-4bbd-9801-f579cca41cf9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:02.140544 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6e22aa6b-29d5-4bbd-9801-f579cca41cf9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:02.146714 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e22aa6b-29d5-4bbd-9801-f579cca41cf9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:02.147202 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e22aa6b-29d5-4bbd-9801-f579cca41cf9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:02.148018 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e22aa6b-29d5-4bbd-9801-f579cca41cf9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:02.148454 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e22aa6b-29d5-4bbd-9801-f579cca41cf9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:02.279629 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6e22aa6b-29d5-4bbd-9801-f579cca41cf9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:02.287376 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6e22aa6b-29d5-4bbd-9801-f579cca41cf9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.151177 Nov 24 15:25:02.287986 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 378/697] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:02 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:03.303444 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-42be3bf6-2b0e-4c23-9082-51ca886816f9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:03.304079 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-42be3bf6-2b0e-4c23-9082-51ca886816f9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:03.310389 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-42be3bf6-2b0e-4c23-9082-51ca886816f9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:03.310865 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-42be3bf6-2b0e-4c23-9082-51ca886816f9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:03.311648 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-42be3bf6-2b0e-4c23-9082-51ca886816f9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:03.312085 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-42be3bf6-2b0e-4c23-9082-51ca886816f9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:03.443639 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-42be3bf6-2b0e-4c23-9082-51ca886816f9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:03.450990 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-42be3bf6-2b0e-4c23-9082-51ca886816f9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.151256 Nov 24 15:25:03.451557 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 320/698] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:03 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:04.467837 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1532a914-9b2f-43eb-a559-daaedfd50f64 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:04.468447 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1532a914-9b2f-43eb-a559-daaedfd50f64 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:04.474874 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1532a914-9b2f-43eb-a559-daaedfd50f64 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:04.475390 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1532a914-9b2f-43eb-a559-daaedfd50f64 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:04.476447 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1532a914-9b2f-43eb-a559-daaedfd50f64 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:04.476877 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1532a914-9b2f-43eb-a559-daaedfd50f64 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:04.610589 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1532a914-9b2f-43eb-a559-daaedfd50f64 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:04.618850 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1532a914-9b2f-43eb-a559-daaedfd50f64 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.154560 Nov 24 15:25:04.619492 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 379/699] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:04 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:05.635932 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f785cc6d-d255-457b-8af1-7ea275a8aef5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:05.636465 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-f785cc6d-d255-457b-8af1-7ea275a8aef5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:05.642658 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f785cc6d-d255-457b-8af1-7ea275a8aef5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:05.643624 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f785cc6d-d255-457b-8af1-7ea275a8aef5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:05.644398 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f785cc6d-d255-457b-8af1-7ea275a8aef5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:05.644826 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f785cc6d-d255-457b-8af1-7ea275a8aef5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:05.783132 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-f785cc6d-d255-457b-8af1-7ea275a8aef5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:05.791091 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f785cc6d-d255-457b-8af1-7ea275a8aef5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.158893 Nov 24 15:25:05.791658 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 321/700] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:05 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:06.808305 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5b067d36-184b-43ab-a22a-fae75b324d72 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:06.809087 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5b067d36-184b-43ab-a22a-fae75b324d72 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:06.815632 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5b067d36-184b-43ab-a22a-fae75b324d72 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:06.816129 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5b067d36-184b-43ab-a22a-fae75b324d72 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:06.816903 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5b067d36-184b-43ab-a22a-fae75b324d72 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:06.817293 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c1da49d5-5091-4256-a532-8010a83ab829 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:06.817753 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5b067d36-184b-43ab-a22a-fae75b324d72 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:06.818383 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c1da49d5-5091-4256-a532-8010a83ab829 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:06.824852 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c1da49d5-5091-4256-a532-8010a83ab829 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:06.825298 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c1da49d5-5091-4256-a532-8010a83ab829 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:06.826358 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c1da49d5-5091-4256-a532-8010a83ab829 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:06.826506 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c1da49d5-5091-4256-a532-8010a83ab829 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:06.860450 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c1da49d5-5091-4256-a532-8010a83ab829 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048009 Nov 24 15:25:06.861021 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 322/701] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:25:06 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:25:06.870913 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ebbf99d5-eddb-4fea-b28e-e5eb910ceaf8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:06.871639 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ebbf99d5-eddb-4fea-b28e-e5eb910ceaf8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:06.878795 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebbf99d5-eddb-4fea-b28e-e5eb910ceaf8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:06.879549 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebbf99d5-eddb-4fea-b28e-e5eb910ceaf8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:06.880455 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebbf99d5-eddb-4fea-b28e-e5eb910ceaf8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:06.880997 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebbf99d5-eddb-4fea-b28e-e5eb910ceaf8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:06.915077 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ebbf99d5-eddb-4fea-b28e-e5eb910ceaf8 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments/6834e1a6-51de-41d5-9b99-12ce475f72a3" status: 200 len: 194 microversion: 2.1 time: 0.047555 Nov 24 15:25:06.915694 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 323/702] 10.222.0.66 () {58 vars in 1412 bytes} [Wed Nov 24 15:25:06 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments/6834e1a6-51de-41d5-9b99-12ce475f72a3 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:25:06.962525 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-5b067d36-184b-43ab-a22a-fae75b324d72 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:06.970098 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5b067d36-184b-43ab-a22a-fae75b324d72 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.165565 Nov 24 15:25:06.970763 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 380/703] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:06 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:07.987620 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-486bc4b5-d347-4a59-bd9f-91f5937e91d9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:07.988230 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-486bc4b5-d347-4a59-bd9f-91f5937e91d9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:07.994784 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-486bc4b5-d347-4a59-bd9f-91f5937e91d9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:07.995255 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-486bc4b5-d347-4a59-bd9f-91f5937e91d9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:07.996031 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-486bc4b5-d347-4a59-bd9f-91f5937e91d9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:07.996457 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-486bc4b5-d347-4a59-bd9f-91f5937e91d9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:08.127832 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-486bc4b5-d347-4a59-bd9f-91f5937e91d9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:08.135216 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-486bc4b5-d347-4a59-bd9f-91f5937e91d9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1509 microversion: 2.1 time: 0.151310 Nov 24 15:25:08.135789 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 324/704] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:07 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:08.151890 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2bc6e0dc-8bce-4935-aa11-c0d217562373 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:08.152457 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2bc6e0dc-8bce-4935-aa11-c0d217562373 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:08.159418 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2bc6e0dc-8bce-4935-aa11-c0d217562373 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:08.159883 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2bc6e0dc-8bce-4935-aa11-c0d217562373 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:08.160670 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2bc6e0dc-8bce-4935-aa11-c0d217562373 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:08.161108 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2bc6e0dc-8bce-4935-aa11-c0d217562373 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:08.218313 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-374448cf-8a20-43fb-ac55-e568e8049c57 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33f2b790-b27c-4c66-8830-91db79216475"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:08.219487 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-374448cf-8a20-43fb-ac55-e568e8049c57 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:08.226445 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-374448cf-8a20-43fb-ac55-e568e8049c57 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:08.226926 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-374448cf-8a20-43fb-ac55-e568e8049c57 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:08.227862 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-374448cf-8a20-43fb-ac55-e568e8049c57 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:08.228299 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-374448cf-8a20-43fb-ac55-e568e8049c57 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:08.234613 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2bc6e0dc-8bce-4935-aa11-c0d217562373 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "POST /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9/action" status: 202 len: 0 microversion: 2.1 time: 0.086247 Nov 24 15:25:08.235252 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 381/705] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:25:08 2021] POST /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:25:08.243750 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-11927b5a-97c6-4d65-9fd8-546596cdfae9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:08.244272 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-11927b5a-97c6-4d65-9fd8-546596cdfae9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:08.250607 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11927b5a-97c6-4d65-9fd8-546596cdfae9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:08.251212 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11927b5a-97c6-4d65-9fd8-546596cdfae9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:08.251997 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11927b5a-97c6-4d65-9fd8-546596cdfae9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:08.252430 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-11927b5a-97c6-4d65-9fd8-546596cdfae9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:08.406707 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-11927b5a-97c6-4d65-9fd8-546596cdfae9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:08.414739 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-11927b5a-97c6-4d65-9fd8-546596cdfae9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1517 microversion: 2.1 time: 0.174528 Nov 24 15:25:08.415733 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 382/706] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:08 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1517 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:08.491336 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-374448cf-8a20-43fb-ac55-e568e8049c57 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276728 Nov 24 15:25:08.491965 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 325/707] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Nov 24 15:25:08 2021] POST /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:25:09.432582 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4515aea4-f6d1-4050-a76b-dbf4a555eb2a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:09.433189 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4515aea4-f6d1-4050-a76b-dbf4a555eb2a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:09.439466 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4515aea4-f6d1-4050-a76b-dbf4a555eb2a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:09.439949 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4515aea4-f6d1-4050-a76b-dbf4a555eb2a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:09.440767 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4515aea4-f6d1-4050-a76b-dbf4a555eb2a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:09.441202 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4515aea4-f6d1-4050-a76b-dbf4a555eb2a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:09.571062 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4515aea4-f6d1-4050-a76b-dbf4a555eb2a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:09.578237 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4515aea4-f6d1-4050-a76b-dbf4a555eb2a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1519 microversion: 2.1 time: 0.149431 Nov 24 15:25:09.578822 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 383/708] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:09 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:10.465716 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-e96eff17-0a07-4ef3-8617-149d1c005046 req-782ba51f-ad8c-469e-9477-7d3b6b6b1876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97e7745-6b55-46b5-a651-17bc3a3bdbc9", "name": "network-vif-unplugged", "status": "completed", "tag": "00062239-b32a-4c2a-9fb5-f6a38539f917"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:10.467269 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:25:10.467269 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:25:10.475070 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-e96eff17-0a07-4ef3-8617-149d1c005046 req-782ba51f-ad8c-469e-9477-7d3b6b6b1876 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:10.475512 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-e96eff17-0a07-4ef3-8617-149d1c005046 req-782ba51f-ad8c-469e-9477-7d3b6b6b1876 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:10.486525 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.compute.server_external_events [req-e96eff17-0a07-4ef3-8617-149d1c005046 req-782ba51f-ad8c-469e-9477-7d3b6b6b1876 service nova] Unable to find a host for instance b97e7745-6b55-46b5-a651-17bc3a3bdbc9. Dropping event network-vif-unplugged {{(pid=116073) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 24 15:25:10.487472 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-e96eff17-0a07-4ef3-8617-149d1c005046 req-782ba51f-ad8c-469e-9477-7d3b6b6b1876 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.085521 Nov 24 15:25:10.488552 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 326/709] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:25:10 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 24 15:25:10.596337 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0ba1d023-5c01-4036-9433-8336a03643e9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:10.598716 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0ba1d023-5c01-4036-9433-8336a03643e9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:10.603598 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0ba1d023-5c01-4036-9433-8336a03643e9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:10.604047 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0ba1d023-5c01-4036-9433-8336a03643e9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:10.604824 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0ba1d023-5c01-4036-9433-8336a03643e9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:10.605255 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0ba1d023-5c01-4036-9433-8336a03643e9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:10.736368 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0ba1d023-5c01-4036-9433-8336a03643e9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:10.744763 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0ba1d023-5c01-4036-9433-8336a03643e9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1519 microversion: 2.1 time: 0.152062 Nov 24 15:25:10.745358 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 384/710] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:10 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:11.761592 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-760ba44e-6969-4f11-a76b-2469f1d3551c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:11.762456 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-760ba44e-6969-4f11-a76b-2469f1d3551c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:11.768823 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-760ba44e-6969-4f11-a76b-2469f1d3551c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:11.769272 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-760ba44e-6969-4f11-a76b-2469f1d3551c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:11.770051 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-760ba44e-6969-4f11-a76b-2469f1d3551c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:11.770482 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-760ba44e-6969-4f11-a76b-2469f1d3551c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:11.900520 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-760ba44e-6969-4f11-a76b-2469f1d3551c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:11.908036 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-760ba44e-6969-4f11-a76b-2469f1d3551c tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1519 microversion: 2.1 time: 0.149972 Nov 24 15:25:11.908546 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 327/711] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:11 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:12.924207 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-83c5cf0f-032e-4840-a791-e9267db52899 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:12.924843 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-83c5cf0f-032e-4840-a791-e9267db52899 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:12.931524 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-83c5cf0f-032e-4840-a791-e9267db52899 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:12.932122 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-83c5cf0f-032e-4840-a791-e9267db52899 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:12.933077 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-83c5cf0f-032e-4840-a791-e9267db52899 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:12.933622 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-83c5cf0f-032e-4840-a791-e9267db52899 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:13.061463 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-83c5cf0f-032e-4840-a791-e9267db52899 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:13.069323 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-83c5cf0f-032e-4840-a791-e9267db52899 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1519 microversion: 2.1 time: 0.148739 Nov 24 15:25:13.069884 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 385/712] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:12 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:14.086645 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-7d16a546-0c15-45c1-8353-86cf8f2298db tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:14.087298 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-7d16a546-0c15-45c1-8353-86cf8f2298db tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:14.093503 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7d16a546-0c15-45c1-8353-86cf8f2298db tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:14.093954 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7d16a546-0c15-45c1-8353-86cf8f2298db tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:14.094729 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7d16a546-0c15-45c1-8353-86cf8f2298db tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:14.095191 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7d16a546-0c15-45c1-8353-86cf8f2298db tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:14.228788 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-7d16a546-0c15-45c1-8353-86cf8f2298db tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:14.236005 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-7d16a546-0c15-45c1-8353-86cf8f2298db tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1519 microversion: 2.1 time: 0.153648 Nov 24 15:25:14.236568 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 328/713] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:14 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:25:15.253320 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-be32cff6-478e-46da-98d1-0c5b8d6ba98a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:15.253923 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-be32cff6-478e-46da-98d1-0c5b8d6ba98a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:15.260291 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-be32cff6-478e-46da-98d1-0c5b8d6ba98a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:15.260737 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-be32cff6-478e-46da-98d1-0c5b8d6ba98a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:15.261508 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-be32cff6-478e-46da-98d1-0c5b8d6ba98a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:15.261940 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-be32cff6-478e-46da-98d1-0c5b8d6ba98a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:15.401180 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-be32cff6-478e-46da-98d1-0c5b8d6ba98a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:15.408854 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-be32cff6-478e-46da-98d1-0c5b8d6ba98a tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1519 microversion: 2.1 time: 0.159212 Nov 24 15:25:15.409430 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 386/714] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:15 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:15.947457 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-80beb828-9a4d-4352-aa6e-60814d219867 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:15.948365 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-80beb828-9a4d-4352-aa6e-60814d219867 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:15.954796 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80beb828-9a4d-4352-aa6e-60814d219867 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:15.955293 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80beb828-9a4d-4352-aa6e-60814d219867 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:15.956120 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80beb828-9a4d-4352-aa6e-60814d219867 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:15.956565 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80beb828-9a4d-4352-aa6e-60814d219867 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:15.986832 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-80beb828-9a4d-4352-aa6e-60814d219867 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042952 Nov 24 15:25:15.987395 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 329/715] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:25:15 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:25:16.205296 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ff731c10-3642-4a5c-bd00-8c50b6f83b02 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:16.205789 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ff731c10-3642-4a5c-bd00-8c50b6f83b02 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:16.211567 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff731c10-3642-4a5c-bd00-8c50b6f83b02 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:16.212018 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff731c10-3642-4a5c-bd00-8c50b6f83b02 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:16.212800 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff731c10-3642-4a5c-bd00-8c50b6f83b02 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:16.213241 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ff731c10-3642-4a5c-bd00-8c50b6f83b02 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:16.242068 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ff731c10-3642-4a5c-bd00-8c50b6f83b02 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments/6834e1a6-51de-41d5-9b99-12ce475f72a3" status: 200 len: 194 microversion: 2.1 time: 0.040569 Nov 24 15:25:16.242674 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 387/716] 10.222.0.66 () {58 vars in 1412 bytes} [Wed Nov 24 15:25:16 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments/6834e1a6-51de-41d5-9b99-12ce475f72a3 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:25:16.252082 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-80d7b9dc-86d3-4f9b-ae65-7e4319e010e6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:16.252568 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-80d7b9dc-86d3-4f9b-ae65-7e4319e010e6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:16.259297 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80d7b9dc-86d3-4f9b-ae65-7e4319e010e6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:16.259742 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80d7b9dc-86d3-4f9b-ae65-7e4319e010e6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:16.260520 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80d7b9dc-86d3-4f9b-ae65-7e4319e010e6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:16.260975 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-80d7b9dc-86d3-4f9b-ae65-7e4319e010e6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:16.338611 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-80d7b9dc-86d3-4f9b-ae65-7e4319e010e6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lazy-loading 'services' on Instance uuid b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:25:16.407937 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-80d7b9dc-86d3-4f9b-ae65-7e4319e010e6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments/6834e1a6-51de-41d5-9b99-12ce475f72a3" status: 202 len: 0 microversion: 2.1 time: 0.159367 Nov 24 15:25:16.408476 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 330/717] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Nov 24 15:25:16 2021] DELETE /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments/6834e1a6-51de-41d5-9b99-12ce475f72a3 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 15:25:16.426547 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-792b7823-b437-4be7-a61f-b0b5e8693df8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:16.427887 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-792b7823-b437-4be7-a61f-b0b5e8693df8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:16.434661 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-792b7823-b437-4be7-a61f-b0b5e8693df8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:16.435149 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-792b7823-b437-4be7-a61f-b0b5e8693df8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:16.435940 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-792b7823-b437-4be7-a61f-b0b5e8693df8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:16.436578 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-792b7823-b437-4be7-a61f-b0b5e8693df8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:16.583923 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-792b7823-b437-4be7-a61f-b0b5e8693df8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:16.591192 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-792b7823-b437-4be7-a61f-b0b5e8693df8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1575 microversion: 2.1 time: 0.168312 Nov 24 15:25:16.591772 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 388/718] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:16 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:17.527181 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-cb945672-544c-486d-9367-d25167bd3792 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:17.527752 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-cb945672-544c-486d-9367-d25167bd3792 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:17.533813 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cb945672-544c-486d-9367-d25167bd3792 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:17.534253 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cb945672-544c-486d-9367-d25167bd3792 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:17.535043 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cb945672-544c-486d-9367-d25167bd3792 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:17.535479 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cb945672-544c-486d-9367-d25167bd3792 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:17.563417 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-cb945672-544c-486d-9367-d25167bd3792 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments/33f2b790-b27c-4c66-8830-91db79216475" status: 200 len: 194 microversion: 2.1 time: 0.040848 Nov 24 15:25:17.563991 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 331/719] 10.222.0.66 () {58 vars in 1412 bytes} [Wed Nov 24 15:25:17 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments/33f2b790-b27c-4c66-8830-91db79216475 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:25:17.574415 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9ef2bde3-a66d-41fa-bb5e-947d7e2efba0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:17.575102 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9ef2bde3-a66d-41fa-bb5e-947d7e2efba0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:17.581258 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ef2bde3-a66d-41fa-bb5e-947d7e2efba0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:17.581699 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ef2bde3-a66d-41fa-bb5e-947d7e2efba0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:17.582469 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ef2bde3-a66d-41fa-bb5e-947d7e2efba0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:17.582927 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ef2bde3-a66d-41fa-bb5e-947d7e2efba0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:17.610155 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-45b35bb5-7a40-4f85-a412-10a7b2deb020 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:17.611046 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-45b35bb5-7a40-4f85-a412-10a7b2deb020 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:17.617904 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-45b35bb5-7a40-4f85-a412-10a7b2deb020 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:17.618356 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-45b35bb5-7a40-4f85-a412-10a7b2deb020 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:17.619161 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-45b35bb5-7a40-4f85-a412-10a7b2deb020 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:17.619982 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-45b35bb5-7a40-4f85-a412-10a7b2deb020 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:17.667426 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-9ef2bde3-a66d-41fa-bb5e-947d7e2efba0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lazy-loading 'services' on Instance uuid b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:25:17.736769 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9ef2bde3-a66d-41fa-bb5e-947d7e2efba0 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments/33f2b790-b27c-4c66-8830-91db79216475" status: 202 len: 0 microversion: 2.1 time: 0.165967 Nov 24 15:25:17.737432 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 389/720] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Nov 24 15:25:17 2021] DELETE /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments/33f2b790-b27c-4c66-8830-91db79216475 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:25:17.762272 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-45b35bb5-7a40-4f85-a412-10a7b2deb020 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:17.771307 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-45b35bb5-7a40-4f85-a412-10a7b2deb020 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1575 microversion: 2.1 time: 0.165906 Nov 24 15:25:17.771942 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 332/721] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:17 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:25:18.789392 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b49a8c1e-70b1-46f7-95a9-4a8e9a7ba821 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:18.790075 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b49a8c1e-70b1-46f7-95a9-4a8e9a7ba821 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:18.796195 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b49a8c1e-70b1-46f7-95a9-4a8e9a7ba821 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:18.796641 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b49a8c1e-70b1-46f7-95a9-4a8e9a7ba821 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:18.797824 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b49a8c1e-70b1-46f7-95a9-4a8e9a7ba821 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:18.797824 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b49a8c1e-70b1-46f7-95a9-4a8e9a7ba821 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:18.891786 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2e664cf2-5a7e-4f6f-add8-abe0dcdd8f05 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:18.892745 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2e664cf2-5a7e-4f6f-add8-abe0dcdd8f05 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:18.899777 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2e664cf2-5a7e-4f6f-add8-abe0dcdd8f05 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:18.900223 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2e664cf2-5a7e-4f6f-add8-abe0dcdd8f05 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:18.900998 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2e664cf2-5a7e-4f6f-add8-abe0dcdd8f05 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:18.901611 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2e664cf2-5a7e-4f6f-add8-abe0dcdd8f05 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:18.930445 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2e664cf2-5a7e-4f6f-add8-abe0dcdd8f05 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042188 Nov 24 15:25:18.931242 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 333/722] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:25:18 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 15:25:18.941199 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b49a8c1e-70b1-46f7-95a9-4a8e9a7ba821 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:18.949220 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b49a8c1e-70b1-46f7-95a9-4a8e9a7ba821 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1575 microversion: 2.1 time: 0.164280 Nov 24 15:25:18.949821 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 390/723] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:18 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:19.034255 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ca6e3e2d-4e61-4e52-b93a-46ae361de173 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:19.035226 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ca6e3e2d-4e61-4e52-b93a-46ae361de173 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:19.041668 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca6e3e2d-4e61-4e52-b93a-46ae361de173 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:19.042071 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca6e3e2d-4e61-4e52-b93a-46ae361de173 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:19.042883 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca6e3e2d-4e61-4e52-b93a-46ae361de173 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:19.043333 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ca6e3e2d-4e61-4e52-b93a-46ae361de173 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:19.073580 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ca6e3e2d-4e61-4e52-b93a-46ae361de173 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043074 Nov 24 15:25:19.074143 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 334/724] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:25:19 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:25:19.127761 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-60231230-e939-4506-b2d4-79179eceb39d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:19.128260 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-60231230-e939-4506-b2d4-79179eceb39d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:19.134589 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60231230-e939-4506-b2d4-79179eceb39d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:19.135075 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60231230-e939-4506-b2d4-79179eceb39d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:19.135857 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60231230-e939-4506-b2d4-79179eceb39d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:19.136292 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-60231230-e939-4506-b2d4-79179eceb39d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:19.159482 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-60231230-e939-4506-b2d4-79179eceb39d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:25:19.230921 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-60231230-e939-4506-b2d4-79179eceb39d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 204 len: 0 microversion: 2.1 time: 0.106425 Nov 24 15:25:19.231493 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 391/725] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:25:19 2021] DELETE /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:25:19.240247 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c030edb8-2252-4000-8e36-2bbb1708569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:19.241112 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c030edb8-2252-4000-8e36-2bbb1708569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:19.247010 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c030edb8-2252-4000-8e36-2bbb1708569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:19.247464 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c030edb8-2252-4000-8e36-2bbb1708569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:19.248248 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c030edb8-2252-4000-8e36-2bbb1708569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:19.248682 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c030edb8-2252-4000-8e36-2bbb1708569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:19.376439 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c030edb8-2252-4000-8e36-2bbb1708569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:19.384599 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c030edb8-2252-4000-8e36-2bbb1708569d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 200 len: 1674 microversion: 2.1 time: 0.148883 Nov 24 15:25:19.385161 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 335/726] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:19 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:19.966597 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-45c9fa57-508b-4464-abf8-4dbb537eff9f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:19.967353 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-45c9fa57-508b-4464-abf8-4dbb537eff9f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:19.973591 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45c9fa57-508b-4464-abf8-4dbb537eff9f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:19.974627 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45c9fa57-508b-4464-abf8-4dbb537eff9f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:19.975507 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45c9fa57-508b-4464-abf8-4dbb537eff9f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:19.975930 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45c9fa57-508b-4464-abf8-4dbb537eff9f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:20.104812 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-45c9fa57-508b-4464-abf8-4dbb537eff9f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:20.112077 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-45c9fa57-508b-4464-abf8-4dbb537eff9f tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1575 microversion: 2.1 time: 0.149426 Nov 24 15:25:20.112641 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 392/727] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:19 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:25:20.401650 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3f5c47a2-896f-4a7c-b811-8af8d92d046f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:20.402200 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3f5c47a2-896f-4a7c-b811-8af8d92d046f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:20.408436 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f5c47a2-896f-4a7c-b811-8af8d92d046f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:20.408883 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f5c47a2-896f-4a7c-b811-8af8d92d046f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:20.409650 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f5c47a2-896f-4a7c-b811-8af8d92d046f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:20.410084 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3f5c47a2-896f-4a7c-b811-8af8d92d046f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:20.541470 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-3f5c47a2-896f-4a7c-b811-8af8d92d046f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:20.548705 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3f5c47a2-896f-4a7c-b811-8af8d92d046f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 200 len: 1674 microversion: 2.1 time: 0.150908 Nov 24 15:25:20.549273 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 336/728] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:20 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:21.129295 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4d9092df-f791-4d26-b17b-b284f8cbac86 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:21.130492 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4d9092df-f791-4d26-b17b-b284f8cbac86 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:21.136929 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4d9092df-f791-4d26-b17b-b284f8cbac86 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:21.137369 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4d9092df-f791-4d26-b17b-b284f8cbac86 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:21.138150 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4d9092df-f791-4d26-b17b-b284f8cbac86 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:21.138576 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4d9092df-f791-4d26-b17b-b284f8cbac86 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:21.272460 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4d9092df-f791-4d26-b17b-b284f8cbac86 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:21.279738 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4d9092df-f791-4d26-b17b-b284f8cbac86 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1575 microversion: 2.1 time: 0.154250 Nov 24 15:25:21.280309 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 393/729] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:21 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:21.565233 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4ddae708-318d-4029-9953-99c67d08279f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:21.565838 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4ddae708-318d-4029-9953-99c67d08279f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:21.572704 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4ddae708-318d-4029-9953-99c67d08279f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:21.573142 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4ddae708-318d-4029-9953-99c67d08279f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:21.573916 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4ddae708-318d-4029-9953-99c67d08279f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:21.574348 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4ddae708-318d-4029-9953-99c67d08279f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:21.718219 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4ddae708-318d-4029-9953-99c67d08279f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a43cdd892899464190fa5a6cfc411ad0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cebad9fcbd0d4232a6f6dccb42ba04a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:21.726547 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4ddae708-318d-4029-9953-99c67d08279f tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 200 len: 1674 microversion: 2.1 time: 0.164902 Nov 24 15:25:21.727160 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 337/730] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:21 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:22.037798 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-086986fd-b7b5-49f9-98c9-f77dec9cf4f7 req-a0ab29fb-96c9-49d2-b03a-854ae30bdd72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e", "name": "network-vif-deleted", "tag": "a9ea99c7-9e9a-429a-a735-dcc12c181098"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:22.039562 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:25:22.039562 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:25:22.046887 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-086986fd-b7b5-49f9-98c9-f77dec9cf4f7 req-a0ab29fb-96c9-49d2-b03a-854ae30bdd72 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:22.047439 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-086986fd-b7b5-49f9-98c9-f77dec9cf4f7 req-a0ab29fb-96c9-49d2-b03a-854ae30bdd72 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:22.060355 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-086986fd-b7b5-49f9-98c9-f77dec9cf4f7 req-a0ab29fb-96c9-49d2-b03a-854ae30bdd72 service nova] Creating event network-vif-deleted:a9ea99c7-9e9a-429a-a735-dcc12c181098 for instance b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e on hv-cinder-80403 Nov 24 15:25:22.071583 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-086986fd-b7b5-49f9-98c9-f77dec9cf4f7 req-a0ab29fb-96c9-49d2-b03a-854ae30bdd72 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099344 Nov 24 15:25:22.072235 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 394/731] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:25:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:25:22.297170 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4302e9df-d03e-4a1a-a5fc-026aec42a6c5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:22.297698 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4302e9df-d03e-4a1a-a5fc-026aec42a6c5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:22.303665 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4302e9df-d03e-4a1a-a5fc-026aec42a6c5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:22.304106 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4302e9df-d03e-4a1a-a5fc-026aec42a6c5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:22.304874 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4302e9df-d03e-4a1a-a5fc-026aec42a6c5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:22.305305 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4302e9df-d03e-4a1a-a5fc-026aec42a6c5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:22.445339 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4302e9df-d03e-4a1a-a5fc-026aec42a6c5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:22.454600 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4302e9df-d03e-4a1a-a5fc-026aec42a6c5 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1575 microversion: 2.1 time: 0.161633 Nov 24 15:25:22.455951 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 338/732] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:22 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:22.745985 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0e9440f0-01f3-467e-b54d-030753a0e5b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:22.746769 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0e9440f0-01f3-467e-b54d-030753a0e5b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:22.753281 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0e9440f0-01f3-467e-b54d-030753a0e5b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:22.753729 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0e9440f0-01f3-467e-b54d-030753a0e5b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:22.754513 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0e9440f0-01f3-467e-b54d-030753a0e5b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:22.754973 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0e9440f0-01f3-467e-b54d-030753a0e5b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:22.768669 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-0e9440f0-01f3-467e-b54d-030753a0e5b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] HTTP exception thrown: Instance b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e could not be found. Nov 24 15:25:22.769242 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0e9440f0-01f3-467e-b54d-030753a0e5b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Returning 404 to user: Instance b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:25:22.770098 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0e9440f0-01f3-467e-b54d-030753a0e5b2 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 404 len: 111 microversion: 2.1 time: 0.029015 Nov 24 15:25:22.770653 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 395/733] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:22 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:25:22.778777 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-95f4d25e-c976-4929-9395-b826269beda5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '.version_select at 0x7f930d4d4790>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:22.797851 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-95f4d25e-c976-4929-9395-b826269beda5 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320683131" status: 202 len: 0 microversion: 2.1 time: 0.022641 Nov 24 15:25:22.798634 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 339/734] 10.222.0.66 () {58 vars in 1220 bytes} [Wed Nov 24 15:25:22 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320683131 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:25:23.472263 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-53d6796f-e900-47df-941e-f48b7368aac3 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:23.472897 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-53d6796f-e900-47df-941e-f48b7368aac3 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:23.479485 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53d6796f-e900-47df-941e-f48b7368aac3 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:23.479934 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53d6796f-e900-47df-941e-f48b7368aac3 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:23.480821 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53d6796f-e900-47df-941e-f48b7368aac3 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:23.481298 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53d6796f-e900-47df-941e-f48b7368aac3 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:23.623628 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-53d6796f-e900-47df-941e-f48b7368aac3 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:23.632009 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-53d6796f-e900-47df-941e-f48b7368aac3 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1575 microversion: 2.1 time: 0.163612 Nov 24 15:25:23.632739 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 396/735] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:23 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:24.649933 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-9d47f357-54c0-4be0-9227-6021f5a15d62 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:24.650633 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-9d47f357-54c0-4be0-9227-6021f5a15d62 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:24.662274 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9d47f357-54c0-4be0-9227-6021f5a15d62 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:24.662274 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9d47f357-54c0-4be0-9227-6021f5a15d62 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:24.662274 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9d47f357-54c0-4be0-9227-6021f5a15d62 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:24.662274 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9d47f357-54c0-4be0-9227-6021f5a15d62 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:24.795710 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-9d47f357-54c0-4be0-9227-6021f5a15d62 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:24.804281 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-9d47f357-54c0-4be0-9227-6021f5a15d62 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1575 microversion: 2.1 time: 0.158621 Nov 24 15:25:24.804852 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 340/736] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:24 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:25.688666 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3a2760b1-99c6-49f4-a718-db5f15acaf8d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:25.689143 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3a2760b1-99c6-49f4-a718-db5f15acaf8d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:25.695905 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a2760b1-99c6-49f4-a718-db5f15acaf8d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:25.696348 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a2760b1-99c6-49f4-a718-db5f15acaf8d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:25.697123 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a2760b1-99c6-49f4-a718-db5f15acaf8d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:25.697554 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3a2760b1-99c6-49f4-a718-db5f15acaf8d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:25.712472 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-3a2760b1-99c6-49f4-a718-db5f15acaf8d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] HTTP exception thrown: Instance b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e could not be found. Nov 24 15:25:25.713044 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3a2760b1-99c6-49f4-a718-db5f15acaf8d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Returning 404 to user: Instance b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:25:25.713869 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3a2760b1-99c6-49f4-a718-db5f15acaf8d tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 404 len: 111 microversion: 2.1 time: 0.028880 Nov 24 15:25:25.714379 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 397/737] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:25:25 2021] DELETE /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:25:25.722008 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-13abe6ca-b046-4e04-86b1-1d43fb5ae09c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:25.722608 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-13abe6ca-b046-4e04-86b1-1d43fb5ae09c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:25.728941 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-13abe6ca-b046-4e04-86b1-1d43fb5ae09c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:25.729389 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-13abe6ca-b046-4e04-86b1-1d43fb5ae09c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:25.730152 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-13abe6ca-b046-4e04-86b1-1d43fb5ae09c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:25.730581 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-13abe6ca-b046-4e04-86b1-1d43fb5ae09c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:25.743779 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-13abe6ca-b046-4e04-86b1-1d43fb5ae09c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] HTTP exception thrown: Instance b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e could not be found. Nov 24 15:25:25.744380 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-13abe6ca-b046-4e04-86b1-1d43fb5ae09c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Returning 404 to user: Instance b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:25:25.745179 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-13abe6ca-b046-4e04-86b1-1d43fb5ae09c tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e" status: 404 len: 111 microversion: 2.1 time: 0.026791 Nov 24 15:25:25.745700 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 341/738] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:25 2021] GET /compute/v2.1/servers/b4b0d73d-cc88-4e7e-9cea-e65e7ab3ae2e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:25:25.821465 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3ee2a13a-09ec-4632-94f4-42412aafd6b8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:25.822600 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3ee2a13a-09ec-4632-94f4-42412aafd6b8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:25.828182 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3ee2a13a-09ec-4632-94f4-42412aafd6b8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:25.828634 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3ee2a13a-09ec-4632-94f4-42412aafd6b8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:25.829411 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3ee2a13a-09ec-4632-94f4-42412aafd6b8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:25.829858 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3ee2a13a-09ec-4632-94f4-42412aafd6b8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:25.966575 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3ee2a13a-09ec-4632-94f4-42412aafd6b8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:25.974578 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3ee2a13a-09ec-4632-94f4-42412aafd6b8 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1575 microversion: 2.1 time: 0.156859 Nov 24 15:25:25.975181 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 398/739] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:25 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:26.582348 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-a097f35a-c0db-4093-9dbe-c277a5b5931d req-0eb3f7ac-a0e1-47f8-a91e-6d42b6f68894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97e7745-6b55-46b5-a651-17bc3a3bdbc9", "name": "network-vif-plugged", "status": "completed", "tag": "00062239-b32a-4c2a-9fb5-f6a38539f917"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:26.583934 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:25:26.583934 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:25:26.591056 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-a097f35a-c0db-4093-9dbe-c277a5b5931d req-0eb3f7ac-a0e1-47f8-a91e-6d42b6f68894 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:26.591565 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-a097f35a-c0db-4093-9dbe-c277a5b5931d req-0eb3f7ac-a0e1-47f8-a91e-6d42b6f68894 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:26.602670 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-a097f35a-c0db-4093-9dbe-c277a5b5931d req-0eb3f7ac-a0e1-47f8-a91e-6d42b6f68894 service nova] Creating event network-vif-plugged:00062239-b32a-4c2a-9fb5-f6a38539f917 for instance b97e7745-6b55-46b5-a651-17bc3a3bdbc9 on hv-cinder-80403 Nov 24 15:25:26.607405 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-a097f35a-c0db-4093-9dbe-c277a5b5931d req-0eb3f7ac-a0e1-47f8-a91e-6d42b6f68894 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028855 Nov 24 15:25:26.607993 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 342/740] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:25:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:25:26.872564 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8341f3bd-cc51-41cd-b866-fe608716e4d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:26.873062 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8341f3bd-cc51-41cd-b866-fe608716e4d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:26.879520 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8341f3bd-cc51-41cd-b866-fe608716e4d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:26.880027 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8341f3bd-cc51-41cd-b866-fe608716e4d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:26.881313 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8341f3bd-cc51-41cd-b866-fe608716e4d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:26.881822 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8341f3bd-cc51-41cd-b866-fe608716e4d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:26.894882 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-8341f3bd-cc51-41cd-b866-fe608716e4d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] HTTP exception thrown: Instance 60818665-e1d1-4651-9b32-94b226a506c9 could not be found. Nov 24 15:25:26.895490 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8341f3bd-cc51-41cd-b866-fe608716e4d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Returning 404 to user: Instance 60818665-e1d1-4651-9b32-94b226a506c9 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:25:26.896302 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8341f3bd-cc51-41cd-b866-fe608716e4d6 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "DELETE /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 404 len: 111 microversion: 2.1 time: 0.027633 Nov 24 15:25:26.896828 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 399/741] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:25:26 2021] DELETE /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:25:26.905659 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-66d81f41-fa72-482c-9cc4-eb77de403ac9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:26.906356 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-66d81f41-fa72-482c-9cc4-eb77de403ac9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] [instance: 60818665-e1d1-4651-9b32-94b226a506c9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:26.913010 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-66d81f41-fa72-482c-9cc4-eb77de403ac9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:26.913458 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-66d81f41-fa72-482c-9cc4-eb77de403ac9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:26.914262 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-66d81f41-fa72-482c-9cc4-eb77de403ac9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:26.914729 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-66d81f41-fa72-482c-9cc4-eb77de403ac9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:26.928193 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-66d81f41-fa72-482c-9cc4-eb77de403ac9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] HTTP exception thrown: Instance 60818665-e1d1-4651-9b32-94b226a506c9 could not be found. Nov 24 15:25:26.928771 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-66d81f41-fa72-482c-9cc4-eb77de403ac9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] Returning 404 to user: Instance 60818665-e1d1-4651-9b32-94b226a506c9 could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:25:26.929583 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-66d81f41-fa72-482c-9cc4-eb77de403ac9 tempest-AttachVolumeTestJSON-1392215435 tempest-AttachVolumeTestJSON-1392215435-project] 10.222.0.66 "GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9" status: 404 len: 111 microversion: 2.1 time: 0.028366 Nov 24 15:25:26.930115 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 343/742] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:26 2021] GET /compute/v2.1/servers/60818665-e1d1-4651-9b32-94b226a506c9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:25:26.992204 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-aae50a05-8812-4629-99e2-a6f0b15e84c9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:26.992859 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-aae50a05-8812-4629-99e2-a6f0b15e84c9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:26.998606 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aae50a05-8812-4629-99e2-a6f0b15e84c9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:26.999086 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aae50a05-8812-4629-99e2-a6f0b15e84c9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:26.999892 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aae50a05-8812-4629-99e2-a6f0b15e84c9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:27.000502 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aae50a05-8812-4629-99e2-a6f0b15e84c9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:27.283929 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-aae50a05-8812-4629-99e2-a6f0b15e84c9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:27.292149 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-aae50a05-8812-4629-99e2-a6f0b15e84c9 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1575 microversion: 2.1 time: 0.304310 Nov 24 15:25:27.292717 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 400/743] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:26 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1575 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:28.309279 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-7cb568d5-0640-43ed-b057-8f826acc7ff4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:28.311406 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-7cb568d5-0640-43ed-b057-8f826acc7ff4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:28.318403 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7cb568d5-0640-43ed-b057-8f826acc7ff4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:28.318897 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7cb568d5-0640-43ed-b057-8f826acc7ff4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:28.319672 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7cb568d5-0640-43ed-b057-8f826acc7ff4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:28.320104 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7cb568d5-0640-43ed-b057-8f826acc7ff4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:28.580401 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-7cb568d5-0640-43ed-b057-8f826acc7ff4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:28.588178 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-7cb568d5-0640-43ed-b057-8f826acc7ff4 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1562 microversion: 2.1 time: 0.283058 Nov 24 15:25:28.588757 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 344/744] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:25:28 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1562 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:33.744406 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7851d45e-d53d-431f-9ab4-d3e8a9eebf7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:33.744901 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7851d45e-d53d-431f-9ab4-d3e8a9eebf7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:33.751331 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7851d45e-d53d-431f-9ab4-d3e8a9eebf7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:33.752023 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7851d45e-d53d-431f-9ab4-d3e8a9eebf7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:33.752546 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7851d45e-d53d-431f-9ab4-d3e8a9eebf7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:33.752980 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7851d45e-d53d-431f-9ab4-d3e8a9eebf7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:33.782690 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7851d45e-d53d-431f-9ab4-d3e8a9eebf7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/os-volume_attachments/ffb093c9-bc97-452a-95bb-2ba6cf74cba4" status: 200 len: 194 microversion: 2.20 time: 0.042014 Nov 24 15:25:33.788714 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 401/745] 10.222.0.66 () {60 vars in 1453 bytes} [Wed Nov 24 15:25:33 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/os-volume_attachments/ffb093c9-bc97-452a-95bb-2ba6cf74cba4 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:25:33.843958 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-d9f068cd-b4bc-4482-874b-9554d833c6cc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:33.844453 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-d9f068cd-b4bc-4482-874b-9554d833c6cc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:33.851246 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d9f068cd-b4bc-4482-874b-9554d833c6cc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:33.851695 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d9f068cd-b4bc-4482-874b-9554d833c6cc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:33.852477 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d9f068cd-b4bc-4482-874b-9554d833c6cc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:33.852906 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d9f068cd-b4bc-4482-874b-9554d833c6cc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:33.933338 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-d9f068cd-b4bc-4482-874b-9554d833c6cc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lazy-loading 'services' on Instance uuid 361e1e6c-853b-4fde-89ed-843a85be79c1 {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:25:34.002995 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-d9f068cd-b4bc-4482-874b-9554d833c6cc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/os-volume_attachments/ffb093c9-bc97-452a-95bb-2ba6cf74cba4" status: 202 len: 0 microversion: 2.20 time: 0.162504 Nov 24 15:25:34.003832 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 345/746] 10.222.0.66 () {60 vars in 1456 bytes} [Wed Nov 24 15:25:33 2021] DELETE /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/os-volume_attachments/ffb093c9-bc97-452a-95bb-2ba6cf74cba4 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:25:34.012889 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c6f16dcd-8712-45ec-8af2-76578d2bceff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:34.013851 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c6f16dcd-8712-45ec-8af2-76578d2bceff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:34.020278 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c6f16dcd-8712-45ec-8af2-76578d2bceff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:34.021519 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c6f16dcd-8712-45ec-8af2-76578d2bceff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:34.022699 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c6f16dcd-8712-45ec-8af2-76578d2bceff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:34.023555 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c6f16dcd-8712-45ec-8af2-76578d2bceff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:34.064859 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c6f16dcd-8712-45ec-8af2-76578d2bceff tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055809 Nov 24 15:25:34.065516 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 402/747] 10.222.0.66 () {60 vars in 1342 bytes} [Wed Nov 24 15:25:34 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:25:35.077708 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4f99b134-4642-4f52-8791-dfc5d2bc4394 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:35.078855 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4f99b134-4642-4f52-8791-dfc5d2bc4394 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:35.085895 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4f99b134-4642-4f52-8791-dfc5d2bc4394 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:35.086336 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4f99b134-4642-4f52-8791-dfc5d2bc4394 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:35.087136 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4f99b134-4642-4f52-8791-dfc5d2bc4394 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:35.087569 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4f99b134-4642-4f52-8791-dfc5d2bc4394 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:35.116348 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4f99b134-4642-4f52-8791-dfc5d2bc4394 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042731 Nov 24 15:25:35.116891 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 346/748] 10.222.0.66 () {60 vars in 1342 bytes} [Wed Nov 24 15:25:35 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:35.170839 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5a216341-c97e-488b-bfbc-029efc68fe5b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:35.171348 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5a216341-c97e-488b-bfbc-029efc68fe5b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:35.177471 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a216341-c97e-488b-bfbc-029efc68fe5b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:35.177912 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a216341-c97e-488b-bfbc-029efc68fe5b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:35.178715 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a216341-c97e-488b-bfbc-029efc68fe5b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:35.179176 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5a216341-c97e-488b-bfbc-029efc68fe5b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:35.202907 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5a216341-c97e-488b-bfbc-029efc68fe5b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:25:35.281971 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5a216341-c97e-488b-bfbc-029efc68fe5b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 204 len: 0 microversion: 2.20 time: 0.114508 Nov 24 15:25:35.282587 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 403/749] 10.222.0.66 () {60 vars in 1279 bytes} [Wed Nov 24 15:25:35 2021] DELETE /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 15:25:35.290948 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-eda2dea6-5376-468f-ad55-8855d5614faa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:35.291562 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-eda2dea6-5376-468f-ad55-8855d5614faa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:35.297410 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eda2dea6-5376-468f-ad55-8855d5614faa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:35.297854 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eda2dea6-5376-468f-ad55-8855d5614faa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:35.298629 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eda2dea6-5376-468f-ad55-8855d5614faa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:35.299112 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eda2dea6-5376-468f-ad55-8855d5614faa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:35.432660 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-eda2dea6-5376-468f-ad55-8855d5614faa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:35.440379 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-eda2dea6-5376-468f-ad55-8855d5614faa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:35.442414 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-eda2dea6-5376-468f-ad55-8855d5614faa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:35.443629 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-eda2dea6-5376-468f-ad55-8855d5614faa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1722 microversion: 2.20 time: 0.156579 Nov 24 15:25:35.444138 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 347/750] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:35 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:25:36.462126 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9120b40d-e8d6-44f9-809a-0cba559b0b0c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:36.462741 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9120b40d-e8d6-44f9-809a-0cba559b0b0c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:36.468983 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9120b40d-e8d6-44f9-809a-0cba559b0b0c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:36.469427 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9120b40d-e8d6-44f9-809a-0cba559b0b0c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:36.470210 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9120b40d-e8d6-44f9-809a-0cba559b0b0c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:36.470643 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9120b40d-e8d6-44f9-809a-0cba559b0b0c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:36.607052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9120b40d-e8d6-44f9-809a-0cba559b0b0c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:36.615518 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9120b40d-e8d6-44f9-809a-0cba559b0b0c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:36.616986 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9120b40d-e8d6-44f9-809a-0cba559b0b0c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:36.618118 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9120b40d-e8d6-44f9-809a-0cba559b0b0c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1722 microversion: 2.20 time: 0.160147 Nov 24 15:25:36.618671 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 404/751] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:36 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:25:37.636339 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b6582e06-7c22-418a-a93d-8ceaa03397b8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:37.637287 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b6582e06-7c22-418a-a93d-8ceaa03397b8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:37.645522 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b6582e06-7c22-418a-a93d-8ceaa03397b8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:37.648343 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b6582e06-7c22-418a-a93d-8ceaa03397b8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:37.649187 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b6582e06-7c22-418a-a93d-8ceaa03397b8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:37.649613 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b6582e06-7c22-418a-a93d-8ceaa03397b8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:37.712789 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-b6582e06-7c22-418a-a93d-8ceaa03397b8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:37.721997 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-b6582e06-7c22-418a-a93d-8ceaa03397b8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:37.723649 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-b6582e06-7c22-418a-a93d-8ceaa03397b8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:37.725134 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b6582e06-7c22-418a-a93d-8ceaa03397b8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1655 microversion: 2.20 time: 0.092512 Nov 24 15:25:37.737966 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 348/752] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:37 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1655 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:25:37.779574 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-db439e86-4306-4329-a6fe-b13e507d9ad4 req-11440e58-a4a8-4f92-b8ec-d2aa9ae34193 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361e1e6c-853b-4fde-89ed-843a85be79c1", "name": "network-vif-deleted", "tag": "66d6070e-c6fb-4ac7-8705-204f502bc368"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:37.783166 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:25:37.783166 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:25:37.793081 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-db439e86-4306-4329-a6fe-b13e507d9ad4 req-11440e58-a4a8-4f92-b8ec-d2aa9ae34193 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:37.793686 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-db439e86-4306-4329-a6fe-b13e507d9ad4 req-11440e58-a4a8-4f92-b8ec-d2aa9ae34193 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:37.806920 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-db439e86-4306-4329-a6fe-b13e507d9ad4 req-11440e58-a4a8-4f92-b8ec-d2aa9ae34193 service nova] Creating event network-vif-deleted:66d6070e-c6fb-4ac7-8705-204f502bc368 for instance 361e1e6c-853b-4fde-89ed-843a85be79c1 on hv-cinder-80403 Nov 24 15:25:37.813758 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-db439e86-4306-4329-a6fe-b13e507d9ad4 req-11440e58-a4a8-4f92-b8ec-d2aa9ae34193 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037674 Nov 24 15:25:37.819308 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 405/753] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:25:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:25:38.744250 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6e7a60a2-cd4b-450f-b501-19bf82890e3a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:38.744860 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6e7a60a2-cd4b-450f-b501-19bf82890e3a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:38.751359 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6e7a60a2-cd4b-450f-b501-19bf82890e3a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:38.751812 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6e7a60a2-cd4b-450f-b501-19bf82890e3a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:38.752597 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6e7a60a2-cd4b-450f-b501-19bf82890e3a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:38.753031 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6e7a60a2-cd4b-450f-b501-19bf82890e3a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:38.783581 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6e7a60a2-cd4b-450f-b501-19bf82890e3a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:38.783943 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6e7a60a2-cd4b-450f-b501-19bf82890e3a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:38.784393 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-6e7a60a2-cd4b-450f-b501-19bf82890e3a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lazy-loading 'fault' on Instance uuid 361e1e6c-853b-4fde-89ed-843a85be79c1 {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:25:38.823410 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6e7a60a2-cd4b-450f-b501-19bf82890e3a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:38.831292 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6e7a60a2-cd4b-450f-b501-19bf82890e3a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:38.833330 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6e7a60a2-cd4b-450f-b501-19bf82890e3a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:38.834470 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6e7a60a2-cd4b-450f-b501-19bf82890e3a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1371 microversion: 2.20 time: 0.093935 Nov 24 15:25:38.835062 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 349/754] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:38 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1371 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:25:39.853626 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-560a21b1-7852-4658-ba1b-32a10c089ebd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:39.854313 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-560a21b1-7852-4658-ba1b-32a10c089ebd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:39.860394 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-560a21b1-7852-4658-ba1b-32a10c089ebd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:39.860840 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-560a21b1-7852-4658-ba1b-32a10c089ebd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:39.861611 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-560a21b1-7852-4658-ba1b-32a10c089ebd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:39.862046 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-560a21b1-7852-4658-ba1b-32a10c089ebd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:39.893403 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-560a21b1-7852-4658-ba1b-32a10c089ebd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:39.893844 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-560a21b1-7852-4658-ba1b-32a10c089ebd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:39.894282 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-560a21b1-7852-4658-ba1b-32a10c089ebd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lazy-loading 'fault' on Instance uuid 361e1e6c-853b-4fde-89ed-843a85be79c1 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:25:39.937599 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-560a21b1-7852-4658-ba1b-32a10c089ebd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:39.945248 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-560a21b1-7852-4658-ba1b-32a10c089ebd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:39.946721 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-560a21b1-7852-4658-ba1b-32a10c089ebd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:39.947889 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-560a21b1-7852-4658-ba1b-32a10c089ebd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 200 len: 1371 microversion: 2.20 time: 0.098755 Nov 24 15:25:39.948442 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 406/755] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:39 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:25:40.965687 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-1c39aad6-f106-4d10-97bf-1ac4d4c1a12a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:40.966301 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-1c39aad6-f106-4d10-97bf-1ac4d4c1a12a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:40.972402 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1c39aad6-f106-4d10-97bf-1ac4d4c1a12a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:40.972857 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1c39aad6-f106-4d10-97bf-1ac4d4c1a12a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:40.973650 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1c39aad6-f106-4d10-97bf-1ac4d4c1a12a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:40.974093 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1c39aad6-f106-4d10-97bf-1ac4d4c1a12a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:40.987655 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-1c39aad6-f106-4d10-97bf-1ac4d4c1a12a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] HTTP exception thrown: Instance 361e1e6c-853b-4fde-89ed-843a85be79c1 could not be found. Nov 24 15:25:40.988247 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-1c39aad6-f106-4d10-97bf-1ac4d4c1a12a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Returning 404 to user: Instance 361e1e6c-853b-4fde-89ed-843a85be79c1 could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:25:40.989965 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-1c39aad6-f106-4d10-97bf-1ac4d4c1a12a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 404 len: 111 microversion: 2.20 time: 0.027830 Nov 24 15:25:40.990129 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 350/756] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:40 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 24 15:25:40.999170 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0b2cfbd4-2b99-4254-86ea-510988d58c83 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '.version_select at 0x7f930cc164c0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:41.020090 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0b2cfbd4-2b99-4254-86ea-510988d58c83 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554345585" status: 204 len: 0 microversion: 2.20 time: 0.025088 Nov 24 15:25:41.020664 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 407/757] 10.222.0.66 () {60 vars in 1261 bytes} [Wed Nov 24 15:25:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1554345585 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 15:25:41.695098 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-edcdfc99-8ee4-4453-9bbd-26fbd4150453 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'create', calling method: .version_select at 0x7f930d5cadc0>, body: {"keypair": {"name": "tempest-keypair-999669314"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:41.713310 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-edcdfc99-8ee4-4453-9bbd-26fbd4150453 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Getting quotas for project 15cfbeac1f3f4700a4806775a9786f5d. Resources: {'key_pairs'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:25:41.717121 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-edcdfc99-8ee4-4453-9bbd-26fbd4150453 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Getting quotas for user b9a6a76c456447a0b1d07b757efaf601 and project 15cfbeac1f3f4700a4806775a9786f5d. Resources: {'key_pairs'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:25:41.830708 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-edcdfc99-8ee4-4453-9bbd-26fbd4150453 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Getting quotas for project 15cfbeac1f3f4700a4806775a9786f5d. Resources: {'key_pairs'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:25:41.834826 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-edcdfc99-8ee4-4453-9bbd-26fbd4150453 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Getting quotas for user b9a6a76c456447a0b1d07b757efaf601 and project 15cfbeac1f3f4700a4806775a9786f5d. Resources: {'key_pairs'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:25:41.847370 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-edcdfc99-8ee4-4453-9bbd-26fbd4150453 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.156435 Nov 24 15:25:41.848523 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 351/758] 10.222.0.66 () {62 vars in 1198 bytes} [Wed Nov 24 15:25:41 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Nov 24 15:25:43.108807 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1829974677", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e130b39d-08a3-4f56-a8c9-cdbf0ac59277"}], "security_groups": [{"name": "tempest-securitygroup--380100852"}], "key_name": "tempest-keypair-999669314", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:43.209935 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] validate_networks() for [('e130b39d-08a3-4f56-a8c9-cdbf0ac59277', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:25:43.884387 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:25:43.884801 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:25:43.885288 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:25:43.885714 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:25:43.886117 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:25:43.894394 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:43.894895 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:43.895784 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:43.896211 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:43.912082 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Getting quotas for project 15cfbeac1f3f4700a4806775a9786f5d. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:25:43.915985 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Getting quotas for user b9a6a76c456447a0b1d07b757efaf601 and project 15cfbeac1f3f4700a4806775a9786f5d. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:25:43.927503 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:25:43.929828 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:25:43.979909 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e75601c9-169e-4839-b046-79655e9003d9 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.875302 Nov 24 15:25:43.980847 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 408/759] 10.222.0.66 () {62 vars in 1187 bytes} [Wed Nov 24 15:25:43 2021] POST /compute/v2.1/servers => generated 401 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 24 15:25:43.993129 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-d301550d-72fc-4127-9fc4-6718c9d01b70 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:43.993735 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-d301550d-72fc-4127-9fc4-6718c9d01b70 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:44.057079 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-d301550d-72fc-4127-9fc4-6718c9d01b70 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:44.065054 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-d301550d-72fc-4127-9fc4-6718c9d01b70 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:44.066693 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-d301550d-72fc-4127-9fc4-6718c9d01b70 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:44.067879 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-d301550d-72fc-4127-9fc4-6718c9d01b70 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1281 microversion: 2.20 time: 0.079480 Nov 24 15:25:44.068530 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 352/760] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:43 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:25:45.085944 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-aa716359-7893-4edc-b81e-b4167f9e0bac tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:45.086634 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-aa716359-7893-4edc-b81e-b4167f9e0bac tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:45.093546 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa716359-7893-4edc-b81e-b4167f9e0bac tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:45.093987 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa716359-7893-4edc-b81e-b4167f9e0bac tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:45.094762 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa716359-7893-4edc-b81e-b4167f9e0bac tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:45.095221 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aa716359-7893-4edc-b81e-b4167f9e0bac tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:45.179303 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-aa716359-7893-4edc-b81e-b4167f9e0bac tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:45.206135 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-aa716359-7893-4edc-b81e-b4167f9e0bac tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:45.208474 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-aa716359-7893-4edc-b81e-b4167f9e0bac tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:45.209610 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-aa716359-7893-4edc-b81e-b4167f9e0bac tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1339 microversion: 2.20 time: 0.128194 Nov 24 15:25:45.210714 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 409/761] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:45 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1339 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:25:46.229195 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-0b1eda74-7936-440a-8e89-ba6dceb16b3f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:46.230552 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-0b1eda74-7936-440a-8e89-ba6dceb16b3f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:46.237583 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0b1eda74-7936-440a-8e89-ba6dceb16b3f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:46.238387 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0b1eda74-7936-440a-8e89-ba6dceb16b3f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:46.239670 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0b1eda74-7936-440a-8e89-ba6dceb16b3f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:46.240347 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0b1eda74-7936-440a-8e89-ba6dceb16b3f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:46.384746 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-0b1eda74-7936-440a-8e89-ba6dceb16b3f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:46.392745 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-0b1eda74-7936-440a-8e89-ba6dceb16b3f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:46.395500 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-0b1eda74-7936-440a-8e89-ba6dceb16b3f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:46.396863 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-0b1eda74-7936-440a-8e89-ba6dceb16b3f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1406 microversion: 2.20 time: 0.171738 Nov 24 15:25:46.407496 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 353/762] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:46 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:25:46.643681 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-62a5ee4d-0e92-43cf-900d-3f238b2583c6 req-88f37a53-7e51-4fd9-85aa-31e2fd2b90f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68310acb-6f2f-4a32-9b65-20ae91f67062", "tag": "071fb078-3f83-4604-a050-d36e5c042f5f"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:46.646046 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:25:46.646046 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:25:46.654084 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-62a5ee4d-0e92-43cf-900d-3f238b2583c6 req-88f37a53-7e51-4fd9-85aa-31e2fd2b90f2 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:46.654772 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-62a5ee4d-0e92-43cf-900d-3f238b2583c6 req-88f37a53-7e51-4fd9-85aa-31e2fd2b90f2 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:46.666545 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-62a5ee4d-0e92-43cf-900d-3f238b2583c6 req-88f37a53-7e51-4fd9-85aa-31e2fd2b90f2 service nova] Creating event network-changed:071fb078-3f83-4604-a050-d36e5c042f5f for instance 68310acb-6f2f-4a32-9b65-20ae91f67062 on hv-cinder-80403 Nov 24 15:25:46.687367 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-62a5ee4d-0e92-43cf-900d-3f238b2583c6 req-88f37a53-7e51-4fd9-85aa-31e2fd2b90f2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047139 Nov 24 15:25:46.688605 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 410/763] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:25:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:25:47.415169 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-d1a21ac4-d216-4e75-880d-af7a4882e6d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:47.415777 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-d1a21ac4-d216-4e75-880d-af7a4882e6d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:47.426439 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d1a21ac4-d216-4e75-880d-af7a4882e6d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:47.427276 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d1a21ac4-d216-4e75-880d-af7a4882e6d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:47.428946 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d1a21ac4-d216-4e75-880d-af7a4882e6d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:47.429993 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d1a21ac4-d216-4e75-880d-af7a4882e6d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:47.578392 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-d1a21ac4-d216-4e75-880d-af7a4882e6d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:47.587695 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-d1a21ac4-d216-4e75-880d-af7a4882e6d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:47.589329 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-d1a21ac4-d216-4e75-880d-af7a4882e6d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:47.590437 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-d1a21ac4-d216-4e75-880d-af7a4882e6d6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1406 microversion: 2.20 time: 0.178931 Nov 24 15:25:47.601490 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 354/764] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:47 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:25:48.610776 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fc7edb65-1d9b-4b2c-9697-aa3da76ea5f2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:48.611496 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fc7edb65-1d9b-4b2c-9697-aa3da76ea5f2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:48.618425 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fc7edb65-1d9b-4b2c-9697-aa3da76ea5f2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:48.618913 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fc7edb65-1d9b-4b2c-9697-aa3da76ea5f2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:48.619703 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fc7edb65-1d9b-4b2c-9697-aa3da76ea5f2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:48.620141 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fc7edb65-1d9b-4b2c-9697-aa3da76ea5f2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:48.791371 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fc7edb65-1d9b-4b2c-9697-aa3da76ea5f2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:48.800344 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fc7edb65-1d9b-4b2c-9697-aa3da76ea5f2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:48.802047 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fc7edb65-1d9b-4b2c-9697-aa3da76ea5f2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:48.803991 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fc7edb65-1d9b-4b2c-9697-aa3da76ea5f2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1406 microversion: 2.20 time: 0.197555 Nov 24 15:25:48.804829 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 411/765] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:48 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:25:49.821653 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-0506208d-a662-4053-8eef-ad2a3e4f6e46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:49.822256 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-0506208d-a662-4053-8eef-ad2a3e4f6e46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:49.828447 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0506208d-a662-4053-8eef-ad2a3e4f6e46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:49.828896 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0506208d-a662-4053-8eef-ad2a3e4f6e46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:49.829670 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0506208d-a662-4053-8eef-ad2a3e4f6e46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:49.830103 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0506208d-a662-4053-8eef-ad2a3e4f6e46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:49.965893 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-0506208d-a662-4053-8eef-ad2a3e4f6e46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:49.973996 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-0506208d-a662-4053-8eef-ad2a3e4f6e46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:49.975678 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-0506208d-a662-4053-8eef-ad2a3e4f6e46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:49.976783 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-0506208d-a662-4053-8eef-ad2a3e4f6e46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1406 microversion: 2.20 time: 0.159396 Nov 24 15:25:49.977335 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 355/766] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:49 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:25:50.844734 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-3dcacfe0-f315-4da0-805d-8626b82d83c6 req-f82756a4-8f2d-490f-a15d-38d919e1d1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68310acb-6f2f-4a32-9b65-20ae91f67062", "name": "network-vif-plugged", "status": "completed", "tag": "071fb078-3f83-4604-a050-d36e5c042f5f"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:50.846244 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:25:50.846244 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:25:50.854767 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-3dcacfe0-f315-4da0-805d-8626b82d83c6 req-f82756a4-8f2d-490f-a15d-38d919e1d1e8 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:50.854767 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-3dcacfe0-f315-4da0-805d-8626b82d83c6 req-f82756a4-8f2d-490f-a15d-38d919e1d1e8 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:50.865872 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-3dcacfe0-f315-4da0-805d-8626b82d83c6 req-f82756a4-8f2d-490f-a15d-38d919e1d1e8 service nova] Creating event network-vif-plugged:071fb078-3f83-4604-a050-d36e5c042f5f for instance 68310acb-6f2f-4a32-9b65-20ae91f67062 on hv-cinder-80403 Nov 24 15:25:50.870507 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-3dcacfe0-f315-4da0-805d-8626b82d83c6 req-f82756a4-8f2d-490f-a15d-38d919e1d1e8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029321 Nov 24 15:25:50.871167 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 412/767] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:25:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:25:50.994709 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8f7ec870-d845-4546-8d40-352064d8d645 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:50.995344 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8f7ec870-d845-4546-8d40-352064d8d645 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:51.001547 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f7ec870-d845-4546-8d40-352064d8d645 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:51.001996 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f7ec870-d845-4546-8d40-352064d8d645 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:51.002768 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f7ec870-d845-4546-8d40-352064d8d645 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:51.003235 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8f7ec870-d845-4546-8d40-352064d8d645 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:51.133684 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8f7ec870-d845-4546-8d40-352064d8d645 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:51.141382 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8f7ec870-d845-4546-8d40-352064d8d645 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:51.142897 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8f7ec870-d845-4546-8d40-352064d8d645 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:51.143991 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8f7ec870-d845-4546-8d40-352064d8d645 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1406 microversion: 2.20 time: 0.152982 Nov 24 15:25:51.144545 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 356/768] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:50 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:25:52.163841 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-07cedd9b-5092-4bfc-a6b5-d2dfbd5ab6fe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:52.164539 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-07cedd9b-5092-4bfc-a6b5-d2dfbd5ab6fe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:52.170781 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-07cedd9b-5092-4bfc-a6b5-d2dfbd5ab6fe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:52.171264 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-07cedd9b-5092-4bfc-a6b5-d2dfbd5ab6fe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:52.172041 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-07cedd9b-5092-4bfc-a6b5-d2dfbd5ab6fe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:52.172475 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-07cedd9b-5092-4bfc-a6b5-d2dfbd5ab6fe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:52.313789 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-07cedd9b-5092-4bfc-a6b5-d2dfbd5ab6fe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:52.321658 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-07cedd9b-5092-4bfc-a6b5-d2dfbd5ab6fe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:52.323178 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-07cedd9b-5092-4bfc-a6b5-d2dfbd5ab6fe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:52.324289 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-07cedd9b-5092-4bfc-a6b5-d2dfbd5ab6fe tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1406 microversion: 2.20 time: 0.165641 Nov 24 15:25:52.324847 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 413/769] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:52 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:25:53.342712 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6ff3fffa-0437-4a5c-85d4-35fc8b6f2ff2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:53.343385 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6ff3fffa-0437-4a5c-85d4-35fc8b6f2ff2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:53.353854 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6ff3fffa-0437-4a5c-85d4-35fc8b6f2ff2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:53.354306 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6ff3fffa-0437-4a5c-85d4-35fc8b6f2ff2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:53.355130 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6ff3fffa-0437-4a5c-85d4-35fc8b6f2ff2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:53.355567 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6ff3fffa-0437-4a5c-85d4-35fc8b6f2ff2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:53.499654 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6ff3fffa-0437-4a5c-85d4-35fc8b6f2ff2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:53.507575 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6ff3fffa-0437-4a5c-85d4-35fc8b6f2ff2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:53.509175 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6ff3fffa-0437-4a5c-85d4-35fc8b6f2ff2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:25:53.510327 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6ff3fffa-0437-4a5c-85d4-35fc8b6f2ff2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1597 microversion: 2.20 time: 0.171473 Nov 24 15:25:53.510929 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 357/770] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:25:53 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1597 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:25:53.529195 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4b18b99c-f811-4734-a148-78dfef134042 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:25:53.529739 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4b18b99c-f811-4734-a148-78dfef134042 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:53.537428 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4b18b99c-f811-4734-a148-78dfef134042 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:53.540899 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4b18b99c-f811-4734-a148-78dfef134042 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:53.541741 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4b18b99c-f811-4734-a148-78dfef134042 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:53.542177 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4b18b99c-f811-4734-a148-78dfef134042 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:53.624113 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4b18b99c-f811-4734-a148-78dfef134042 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098984 Nov 24 15:25:53.624777 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 414/771] 10.222.0.66 () {60 vars in 1315 bytes} [Wed Nov 24 15:25:53 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:25:54.601276 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ff400f56-9c11-4bf4-a0f7-f04e47683cc8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:54.602244 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ff400f56-9c11-4bf4-a0f7-f04e47683cc8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:54.607970 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-9317fd8e-cede-48b5-96a5-bec2ec1d2d87 req-518b05d0-d505-45c7-9e10-fa3d1bf23ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68310acb-6f2f-4a32-9b65-20ae91f67062", "tag": "071fb078-3f83-4604-a050-d36e5c042f5f"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:54.609451 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:25:54.609451 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:25:54.621939 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-9317fd8e-cede-48b5-96a5-bec2ec1d2d87 req-518b05d0-d505-45c7-9e10-fa3d1bf23ebf service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:54.623724 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff400f56-9c11-4bf4-a0f7-f04e47683cc8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:54.624168 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff400f56-9c11-4bf4-a0f7-f04e47683cc8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:54.625155 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff400f56-9c11-4bf4-a0f7-f04e47683cc8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:54.625591 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ff400f56-9c11-4bf4-a0f7-f04e47683cc8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:54.631066 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-9317fd8e-cede-48b5-96a5-bec2ec1d2d87 req-518b05d0-d505-45c7-9e10-fa3d1bf23ebf service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:54.650981 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-9317fd8e-cede-48b5-96a5-bec2ec1d2d87 req-518b05d0-d505-45c7-9e10-fa3d1bf23ebf service nova] Creating event network-changed:071fb078-3f83-4604-a050-d36e5c042f5f for instance 68310acb-6f2f-4a32-9b65-20ae91f67062 on hv-cinder-80403 Nov 24 15:25:54.657854 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-9317fd8e-cede-48b5-96a5-bec2ec1d2d87 req-518b05d0-d505-45c7-9e10-fa3d1bf23ebf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053754 Nov 24 15:25:54.658613 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 415/772] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:25:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:25:54.704189 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ff400f56-9c11-4bf4-a0f7-f04e47683cc8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 14 microversion: 2.20 time: 0.106576 Nov 24 15:25:54.704966 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 358/773] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:25:54 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:55.717073 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-901ac9d0-39c7-45c5-ac32-b4b06b17022d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:55.718156 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-901ac9d0-39c7-45c5-ac32-b4b06b17022d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:55.724546 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-901ac9d0-39c7-45c5-ac32-b4b06b17022d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:55.725119 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-901ac9d0-39c7-45c5-ac32-b4b06b17022d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:55.725999 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-901ac9d0-39c7-45c5-ac32-b4b06b17022d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:55.726503 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-901ac9d0-39c7-45c5-ac32-b4b06b17022d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:55.799285 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-901ac9d0-39c7-45c5-ac32-b4b06b17022d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 14 microversion: 2.20 time: 0.086898 Nov 24 15:25:55.799933 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 416/774] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:25:55 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:56.811938 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-adfe5a12-79ef-4d1b-a16c-1ca2d3652cc8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:56.812916 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-adfe5a12-79ef-4d1b-a16c-1ca2d3652cc8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:56.819373 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-adfe5a12-79ef-4d1b-a16c-1ca2d3652cc8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:56.819873 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-adfe5a12-79ef-4d1b-a16c-1ca2d3652cc8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:56.820586 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-adfe5a12-79ef-4d1b-a16c-1ca2d3652cc8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:56.821015 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-adfe5a12-79ef-4d1b-a16c-1ca2d3652cc8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:56.880880 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-adfe5a12-79ef-4d1b-a16c-1ca2d3652cc8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 14 microversion: 2.20 time: 0.072886 Nov 24 15:25:56.881754 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 359/775] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:25:56 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:57.892264 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0d0ebe6e-1e2e-4e41-a3ca-90ea5eaa8f46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:57.893240 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0d0ebe6e-1e2e-4e41-a3ca-90ea5eaa8f46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:57.900099 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d0ebe6e-1e2e-4e41-a3ca-90ea5eaa8f46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:57.900546 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d0ebe6e-1e2e-4e41-a3ca-90ea5eaa8f46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:57.901310 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d0ebe6e-1e2e-4e41-a3ca-90ea5eaa8f46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:57.901737 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d0ebe6e-1e2e-4e41-a3ca-90ea5eaa8f46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:57.963850 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0d0ebe6e-1e2e-4e41-a3ca-90ea5eaa8f46 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 14 microversion: 2.20 time: 0.075397 Nov 24 15:25:57.964640 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 417/776] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:25:57 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:25:58.975871 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-05d3c3d8-0f54-445f-8003-fb4049a47bf6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:25:58.976894 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-05d3c3d8-0f54-445f-8003-fb4049a47bf6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:25:58.983912 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-05d3c3d8-0f54-445f-8003-fb4049a47bf6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:58.984354 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-05d3c3d8-0f54-445f-8003-fb4049a47bf6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:58.985127 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-05d3c3d8-0f54-445f-8003-fb4049a47bf6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:25:58.985563 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-05d3c3d8-0f54-445f-8003-fb4049a47bf6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:25:59.046237 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-05d3c3d8-0f54-445f-8003-fb4049a47bf6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 14 microversion: 2.20 time: 0.074870 Nov 24 15:25:59.046888 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 360/777] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:25:58 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:26:00.057993 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1cb39ee4-8bd9-423b-92cc-4c93d0468e25 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:00.060025 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1cb39ee4-8bd9-423b-92cc-4c93d0468e25 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:00.068269 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1cb39ee4-8bd9-423b-92cc-4c93d0468e25 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:00.068932 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1cb39ee4-8bd9-423b-92cc-4c93d0468e25 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:00.069806 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1cb39ee4-8bd9-423b-92cc-4c93d0468e25 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:00.070315 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1cb39ee4-8bd9-423b-92cc-4c93d0468e25 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:00.147747 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1cb39ee4-8bd9-423b-92cc-4c93d0468e25 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 14 microversion: 2.20 time: 0.093412 Nov 24 15:26:00.151135 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 418/778] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:00 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:26:01.158392 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-9f920172-f0b9-46b0-919c-9ecd8784d1bd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:01.159397 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-9f920172-f0b9-46b0-919c-9ecd8784d1bd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:01.166217 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9f920172-f0b9-46b0-919c-9ecd8784d1bd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:01.166660 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9f920172-f0b9-46b0-919c-9ecd8784d1bd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:01.167460 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9f920172-f0b9-46b0-919c-9ecd8784d1bd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:01.167922 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9f920172-f0b9-46b0-919c-9ecd8784d1bd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:01.226494 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-9f920172-f0b9-46b0-919c-9ecd8784d1bd tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 14 microversion: 2.20 time: 0.071976 Nov 24 15:26:01.227437 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 361/779] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:01 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:26:02.237183 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5124047d-1be4-4737-8b2b-757b0800587c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:02.238214 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-5124047d-1be4-4737-8b2b-757b0800587c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:02.245267 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5124047d-1be4-4737-8b2b-757b0800587c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:02.245715 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5124047d-1be4-4737-8b2b-757b0800587c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:02.246505 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5124047d-1be4-4737-8b2b-757b0800587c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:02.246967 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-5124047d-1be4-4737-8b2b-757b0800587c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:02.311991 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5124047d-1be4-4737-8b2b-757b0800587c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 14 microversion: 2.20 time: 0.078647 Nov 24 15:26:02.312781 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 419/780] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:02 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:26:03.324588 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a10a37cf-4e3d-4c35-abe1-3bab7fbb0118 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:03.325587 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a10a37cf-4e3d-4c35-abe1-3bab7fbb0118 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:03.332445 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a10a37cf-4e3d-4c35-abe1-3bab7fbb0118 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:03.332890 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a10a37cf-4e3d-4c35-abe1-3bab7fbb0118 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:03.333683 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a10a37cf-4e3d-4c35-abe1-3bab7fbb0118 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:03.334118 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a10a37cf-4e3d-4c35-abe1-3bab7fbb0118 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:03.398348 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a10a37cf-4e3d-4c35-abe1-3bab7fbb0118 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 14 microversion: 2.20 time: 0.077572 Nov 24 15:26:03.401526 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 362/781] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:03 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:26:04.409674 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3f356949-37da-4942-b29e-f10b1e1c8771 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:04.410688 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3f356949-37da-4942-b29e-f10b1e1c8771 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:04.417968 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f356949-37da-4942-b29e-f10b1e1c8771 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:04.418409 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f356949-37da-4942-b29e-f10b1e1c8771 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:04.419215 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f356949-37da-4942-b29e-f10b1e1c8771 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:04.419672 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f356949-37da-4942-b29e-f10b1e1c8771 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:06.511276 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3f356949-37da-4942-b29e-f10b1e1c8771 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 18561 microversion: 2.20 time: 2.105601 Nov 24 15:26:06.512544 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 420/782] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:04 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 18561 bytes in 2108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:07.523853 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-0513f290-3120-4422-80aa-ade58038fb53 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:07.524876 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-0513f290-3120-4422-80aa-ade58038fb53 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:07.531779 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0513f290-3120-4422-80aa-ade58038fb53 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:07.532224 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0513f290-3120-4422-80aa-ade58038fb53 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:07.532988 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0513f290-3120-4422-80aa-ade58038fb53 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:07.533416 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0513f290-3120-4422-80aa-ade58038fb53 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:07.601226 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-0513f290-3120-4422-80aa-ade58038fb53 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 19342 microversion: 2.20 time: 0.081943 Nov 24 15:26:07.602109 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 363/783] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:07 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 19342 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:08.613040 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-665b0e5d-77db-4e81-beb7-d76c21608b84 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:08.614290 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-665b0e5d-77db-4e81-beb7-d76c21608b84 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:08.621741 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-665b0e5d-77db-4e81-beb7-d76c21608b84 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:08.622193 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-665b0e5d-77db-4e81-beb7-d76c21608b84 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:08.623011 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-665b0e5d-77db-4e81-beb7-d76c21608b84 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:08.623450 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-665b0e5d-77db-4e81-beb7-d76c21608b84 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:08.691531 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-665b0e5d-77db-4e81-beb7-d76c21608b84 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 21935 microversion: 2.20 time: 0.082187 Nov 24 15:26:08.691940 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 421/784] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:08 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 21935 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:09.703525 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3b85a176-f6d3-4160-8e40-5d7cf8efa8bc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:09.704451 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3b85a176-f6d3-4160-8e40-5d7cf8efa8bc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:09.711981 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3b85a176-f6d3-4160-8e40-5d7cf8efa8bc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:09.712423 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3b85a176-f6d3-4160-8e40-5d7cf8efa8bc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:09.713188 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3b85a176-f6d3-4160-8e40-5d7cf8efa8bc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:09.713619 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3b85a176-f6d3-4160-8e40-5d7cf8efa8bc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:09.782070 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3b85a176-f6d3-4160-8e40-5d7cf8efa8bc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 23235 microversion: 2.20 time: 0.082553 Nov 24 15:26:09.783007 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 364/785] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:09 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 23235 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:10.794668 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8d9dbc35-b813-4e4a-b198-4a5a930e7431 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:10.795802 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8d9dbc35-b813-4e4a-b198-4a5a930e7431 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:10.802598 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d9dbc35-b813-4e4a-b198-4a5a930e7431 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:10.803167 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d9dbc35-b813-4e4a-b198-4a5a930e7431 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:10.803932 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d9dbc35-b813-4e4a-b198-4a5a930e7431 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:10.804369 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8d9dbc35-b813-4e4a-b198-4a5a930e7431 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:10.881521 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8d9dbc35-b813-4e4a-b198-4a5a930e7431 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 25004 microversion: 2.20 time: 0.090842 Nov 24 15:26:10.882437 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 422/786] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:10 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 25004 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:11.893343 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-37541a91-e85e-4c0f-94f0-1b77ff05a2d5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:11.894371 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-37541a91-e85e-4c0f-94f0-1b77ff05a2d5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:11.902776 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-37541a91-e85e-4c0f-94f0-1b77ff05a2d5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:11.903257 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-37541a91-e85e-4c0f-94f0-1b77ff05a2d5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:11.904047 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-37541a91-e85e-4c0f-94f0-1b77ff05a2d5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:11.904485 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-37541a91-e85e-4c0f-94f0-1b77ff05a2d5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:11.988890 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-37541a91-e85e-4c0f-94f0-1b77ff05a2d5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 26498 microversion: 2.20 time: 0.099334 Nov 24 15:26:11.990779 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 365/787] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:11 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 26498 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:13.001046 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1f396313-0f59-4137-83b7-49129a1c1cb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:13.002025 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1f396313-0f59-4137-83b7-49129a1c1cb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:13.009785 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1f396313-0f59-4137-83b7-49129a1c1cb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:13.010220 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1f396313-0f59-4137-83b7-49129a1c1cb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:13.011023 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1f396313-0f59-4137-83b7-49129a1c1cb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:13.011452 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1f396313-0f59-4137-83b7-49129a1c1cb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:13.085871 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1f396313-0f59-4137-83b7-49129a1c1cb0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 27624 microversion: 2.20 time: 0.088711 Nov 24 15:26:13.086416 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 423/788] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:12 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 27624 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:14.097690 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-70074460-88a0-4cd1-81a5-f3599cc7e820 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:14.098791 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-70074460-88a0-4cd1-81a5-f3599cc7e820 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:14.106175 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-70074460-88a0-4cd1-81a5-f3599cc7e820 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:14.106628 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-70074460-88a0-4cd1-81a5-f3599cc7e820 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:14.107434 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-70074460-88a0-4cd1-81a5-f3599cc7e820 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:14.107870 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-70074460-88a0-4cd1-81a5-f3599cc7e820 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:14.193489 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-70074460-88a0-4cd1-81a5-f3599cc7e820 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 28089 microversion: 2.20 time: 0.099651 Nov 24 15:26:14.194223 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 366/789] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:14 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 28089 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:15.205600 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4230984c-c595-492f-add5-8bc333f53aad tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:15.206664 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4230984c-c595-492f-add5-8bc333f53aad tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:15.214266 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4230984c-c595-492f-add5-8bc333f53aad tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:15.214735 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4230984c-c595-492f-add5-8bc333f53aad tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:15.215698 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4230984c-c595-492f-add5-8bc333f53aad tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:15.216135 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4230984c-c595-492f-add5-8bc333f53aad tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:15.290052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4230984c-c595-492f-add5-8bc333f53aad tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 28232 microversion: 2.20 time: 0.088332 Nov 24 15:26:15.290828 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 424/790] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:15 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 28232 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:16.302129 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-11b024a7-5141-4b31-b121-c7fb1c46be7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:16.303175 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-11b024a7-5141-4b31-b121-c7fb1c46be7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:16.310666 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-11b024a7-5141-4b31-b121-c7fb1c46be7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:16.311176 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-11b024a7-5141-4b31-b121-c7fb1c46be7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:16.311992 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-11b024a7-5141-4b31-b121-c7fb1c46be7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:16.312426 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-11b024a7-5141-4b31-b121-c7fb1c46be7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:16.386686 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-11b024a7-5141-4b31-b121-c7fb1c46be7e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 28444 microversion: 2.20 time: 0.088516 Nov 24 15:26:16.387435 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 367/791] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:16 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 28444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:17.398622 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c1689319-ef17-4e43-94a0-f1f8c7bda386 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:17.399677 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c1689319-ef17-4e43-94a0-f1f8c7bda386 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:17.406765 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c1689319-ef17-4e43-94a0-f1f8c7bda386 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:17.407258 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c1689319-ef17-4e43-94a0-f1f8c7bda386 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:17.408055 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c1689319-ef17-4e43-94a0-f1f8c7bda386 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:17.408477 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c1689319-ef17-4e43-94a0-f1f8c7bda386 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:17.484267 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c1689319-ef17-4e43-94a0-f1f8c7bda386 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 28690 microversion: 2.20 time: 0.089697 Nov 24 15:26:17.484938 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 425/792] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:17 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 28690 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 15:26:18.496928 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-450d6d48-2fa7-4f06-8be7-a0b490232ba0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:18.498075 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-450d6d48-2fa7-4f06-8be7-a0b490232ba0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:18.505048 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-450d6d48-2fa7-4f06-8be7-a0b490232ba0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:18.505490 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-450d6d48-2fa7-4f06-8be7-a0b490232ba0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:18.506334 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-450d6d48-2fa7-4f06-8be7-a0b490232ba0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:18.507380 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-450d6d48-2fa7-4f06-8be7-a0b490232ba0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:18.571960 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-450d6d48-2fa7-4f06-8be7-a0b490232ba0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 28690 microversion: 2.20 time: 0.078907 Nov 24 15:26:18.572608 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 368/793] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:18 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 28690 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:19.584031 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ae07b142-adcb-48ae-b9f2-818b12da653b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:19.585524 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ae07b142-adcb-48ae-b9f2-818b12da653b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:19.592492 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae07b142-adcb-48ae-b9f2-818b12da653b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:19.592941 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae07b142-adcb-48ae-b9f2-818b12da653b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:19.593719 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae07b142-adcb-48ae-b9f2-818b12da653b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:19.594162 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae07b142-adcb-48ae-b9f2-818b12da653b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:19.654134 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ae07b142-adcb-48ae-b9f2-818b12da653b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 28690 microversion: 2.20 time: 0.074020 Nov 24 15:26:19.654769 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 426/794] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:19 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 28690 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:20.666767 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4e84138a-6520-426d-ad52-dfcf54ca046f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:20.667788 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4e84138a-6520-426d-ad52-dfcf54ca046f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:20.674602 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4e84138a-6520-426d-ad52-dfcf54ca046f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:20.675082 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4e84138a-6520-426d-ad52-dfcf54ca046f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:20.675864 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4e84138a-6520-426d-ad52-dfcf54ca046f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:20.676301 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4e84138a-6520-426d-ad52-dfcf54ca046f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:20.740925 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4e84138a-6520-426d-ad52-dfcf54ca046f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 28690 microversion: 2.20 time: 0.078439 Nov 24 15:26:20.741593 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 369/795] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:20 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 28690 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:21.752770 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-693cb868-783e-4fd1-b182-13f16e71ee5e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:21.753776 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-693cb868-783e-4fd1-b182-13f16e71ee5e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:21.760785 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-693cb868-783e-4fd1-b182-13f16e71ee5e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:21.761240 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-693cb868-783e-4fd1-b182-13f16e71ee5e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:21.762017 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-693cb868-783e-4fd1-b182-13f16e71ee5e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:21.762456 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-693cb868-783e-4fd1-b182-13f16e71ee5e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:21.839612 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-693cb868-783e-4fd1-b182-13f16e71ee5e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 29978 microversion: 2.20 time: 0.090638 Nov 24 15:26:21.840170 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 427/796] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:21 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 29978 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:22.851808 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8b8e80c8-c29c-4664-bb64-3ea95fdba136 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:22.852706 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8b8e80c8-c29c-4664-bb64-3ea95fdba136 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:22.859492 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8b8e80c8-c29c-4664-bb64-3ea95fdba136 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:22.859934 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8b8e80c8-c29c-4664-bb64-3ea95fdba136 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:22.860693 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8b8e80c8-c29c-4664-bb64-3ea95fdba136 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:22.861119 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8b8e80c8-c29c-4664-bb64-3ea95fdba136 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:22.942302 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8b8e80c8-c29c-4664-bb64-3ea95fdba136 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 31759 microversion: 2.20 time: 0.094385 Nov 24 15:26:22.943503 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 370/797] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:22 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 31759 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:23.955374 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3cccebfb-99ff-4593-9863-3a027deff1d1 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:23.956291 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3cccebfb-99ff-4593-9863-3a027deff1d1 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:23.963769 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cccebfb-99ff-4593-9863-3a027deff1d1 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:23.964216 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cccebfb-99ff-4593-9863-3a027deff1d1 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:23.965175 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cccebfb-99ff-4593-9863-3a027deff1d1 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:23.965700 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3cccebfb-99ff-4593-9863-3a027deff1d1 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:24.042325 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3cccebfb-99ff-4593-9863-3a027deff1d1 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 33254 microversion: 2.20 time: 0.090909 Nov 24 15:26:24.043001 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 428/798] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:23 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 33254 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:25.055052 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-df5f6a43-3d3b-46eb-bdf8-825b14cebdd3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:25.056061 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-df5f6a43-3d3b-46eb-bdf8-825b14cebdd3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:25.063041 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-df5f6a43-3d3b-46eb-bdf8-825b14cebdd3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:25.063498 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-df5f6a43-3d3b-46eb-bdf8-825b14cebdd3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:25.064282 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-df5f6a43-3d3b-46eb-bdf8-825b14cebdd3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:25.064724 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-df5f6a43-3d3b-46eb-bdf8-825b14cebdd3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:25.141203 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-df5f6a43-3d3b-46eb-bdf8-825b14cebdd3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 34045 microversion: 2.20 time: 0.090307 Nov 24 15:26:25.141887 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 371/799] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:25 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 34045 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:26.153634 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a3caa57f-84e2-48f3-a0ef-bd5c920867ab tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:26.154612 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a3caa57f-84e2-48f3-a0ef-bd5c920867ab tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:26.161411 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a3caa57f-84e2-48f3-a0ef-bd5c920867ab tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:26.161882 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a3caa57f-84e2-48f3-a0ef-bd5c920867ab tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:26.163207 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a3caa57f-84e2-48f3-a0ef-bd5c920867ab tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:26.163636 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a3caa57f-84e2-48f3-a0ef-bd5c920867ab tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:26.243564 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a3caa57f-84e2-48f3-a0ef-bd5c920867ab tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 35071 microversion: 2.20 time: 0.093729 Nov 24 15:26:26.245065 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 429/800] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:26 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 35071 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:27.256470 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-bb31ff2b-ba9c-4654-83a5-6c18e20d92b1 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:27.258107 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-bb31ff2b-ba9c-4654-83a5-6c18e20d92b1 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:27.265060 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bb31ff2b-ba9c-4654-83a5-6c18e20d92b1 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:27.265500 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bb31ff2b-ba9c-4654-83a5-6c18e20d92b1 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:27.266273 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bb31ff2b-ba9c-4654-83a5-6c18e20d92b1 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:27.266702 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bb31ff2b-ba9c-4654-83a5-6c18e20d92b1 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:27.340552 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-bb31ff2b-ba9c-4654-83a5-6c18e20d92b1 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 36277 microversion: 2.20 time: 0.088041 Nov 24 15:26:27.341205 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 372/801] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:27 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 36277 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:28.352931 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b0db46f7-6dbf-46b3-8c17-59551e8e894a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:28.353943 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b0db46f7-6dbf-46b3-8c17-59551e8e894a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:28.360753 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b0db46f7-6dbf-46b3-8c17-59551e8e894a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:28.361195 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b0db46f7-6dbf-46b3-8c17-59551e8e894a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:28.361958 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b0db46f7-6dbf-46b3-8c17-59551e8e894a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:28.362384 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b0db46f7-6dbf-46b3-8c17-59551e8e894a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:28.439157 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b0db46f7-6dbf-46b3-8c17-59551e8e894a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 37697 microversion: 2.20 time: 0.090034 Nov 24 15:26:28.439989 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 430/802] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:28 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 37697 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 15:26:29.451878 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8505f354-a219-4c75-ad8d-cfeaaf9629f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:29.452903 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8505f354-a219-4c75-ad8d-cfeaaf9629f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:29.460387 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8505f354-a219-4c75-ad8d-cfeaaf9629f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:29.460884 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8505f354-a219-4c75-ad8d-cfeaaf9629f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:29.461659 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8505f354-a219-4c75-ad8d-cfeaaf9629f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:29.462092 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8505f354-a219-4c75-ad8d-cfeaaf9629f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:29.538577 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8505f354-a219-4c75-ad8d-cfeaaf9629f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 38247 microversion: 2.20 time: 0.089997 Nov 24 15:26:29.539418 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 373/803] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:29 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 38247 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:30.550896 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-668dc8c1-9fa0-4ec8-a79f-dce0344096b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:30.551901 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-668dc8c1-9fa0-4ec8-a79f-dce0344096b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:30.559400 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-668dc8c1-9fa0-4ec8-a79f-dce0344096b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:30.559855 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-668dc8c1-9fa0-4ec8-a79f-dce0344096b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:30.560633 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-668dc8c1-9fa0-4ec8-a79f-dce0344096b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:30.561104 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-668dc8c1-9fa0-4ec8-a79f-dce0344096b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:30.622361 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-668dc8c1-9fa0-4ec8-a79f-dce0344096b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 38247 microversion: 2.20 time: 0.075458 Nov 24 15:26:30.623011 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 431/804] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:30 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 38247 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:31.635316 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ebe13245-0f5d-4968-a038-57551da18dfc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:31.636262 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ebe13245-0f5d-4968-a038-57551da18dfc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:31.643098 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebe13245-0f5d-4968-a038-57551da18dfc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:31.643547 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebe13245-0f5d-4968-a038-57551da18dfc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:31.644318 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebe13245-0f5d-4968-a038-57551da18dfc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:31.644754 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ebe13245-0f5d-4968-a038-57551da18dfc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:31.707800 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ebe13245-0f5d-4968-a038-57551da18dfc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 38247 microversion: 2.20 time: 0.076981 Nov 24 15:26:31.708431 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 374/805] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:31 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 38247 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:32.720710 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-17a07fb9-94bd-40c0-9dd2-cc1e74424c44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:32.721782 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-17a07fb9-94bd-40c0-9dd2-cc1e74424c44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:32.729248 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-17a07fb9-94bd-40c0-9dd2-cc1e74424c44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:32.729693 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-17a07fb9-94bd-40c0-9dd2-cc1e74424c44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:32.730462 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-17a07fb9-94bd-40c0-9dd2-cc1e74424c44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:32.730930 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-17a07fb9-94bd-40c0-9dd2-cc1e74424c44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:32.802273 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-17a07fb9-94bd-40c0-9dd2-cc1e74424c44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 38253 microversion: 2.20 time: 0.085613 Nov 24 15:26:32.802956 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 432/806] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:32 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 38253 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 24 15:26:33.814230 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f0e5745a-4158-45b3-9872-eb3115a627bb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:33.815245 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-f0e5745a-4158-45b3-9872-eb3115a627bb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:33.822544 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f0e5745a-4158-45b3-9872-eb3115a627bb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:33.823015 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f0e5745a-4158-45b3-9872-eb3115a627bb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:33.823788 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f0e5745a-4158-45b3-9872-eb3115a627bb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:33.824216 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f0e5745a-4158-45b3-9872-eb3115a627bb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:33.898457 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f0e5745a-4158-45b3-9872-eb3115a627bb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 200 len: 38390 microversion: 2.20 time: 0.088124 Nov 24 15:26:33.899135 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 375/807] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:33 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 38390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:26:33.909349 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e2754a5f-0b96-4c82-8c9b-4373d6794e32 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:33.909920 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e2754a5f-0b96-4c82-8c9b-4373d6794e32 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:33.917222 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2754a5f-0b96-4c82-8c9b-4373d6794e32 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:33.917663 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2754a5f-0b96-4c82-8c9b-4373d6794e32 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:33.918430 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2754a5f-0b96-4c82-8c9b-4373d6794e32 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:33.918882 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2754a5f-0b96-4c82-8c9b-4373d6794e32 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:33.943292 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e2754a5f-0b96-4c82-8c9b-4373d6794e32 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/ips" status: 200 len: 150 microversion: 2.20 time: 0.038002 Nov 24 15:26:33.943869 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 433/808] 10.222.0.66 () {60 vars in 1288 bytes} [Wed Nov 24 15:26:33 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:26:36.050087 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-fd6d42f2-2453-4e45-8eb9-4dfff3a677df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:36.050715 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-fd6d42f2-2453-4e45-8eb9-4dfff3a677df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:36.057790 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fd6d42f2-2453-4e45-8eb9-4dfff3a677df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:36.058236 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fd6d42f2-2453-4e45-8eb9-4dfff3a677df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:36.059027 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fd6d42f2-2453-4e45-8eb9-4dfff3a677df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:36.059456 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fd6d42f2-2453-4e45-8eb9-4dfff3a677df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:36.082570 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-fd6d42f2-2453-4e45-8eb9-4dfff3a677df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lazy-loading 'flavor' on Instance uuid 68310acb-6f2f-4a32-9b65-20ae91f67062 {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:26:36.331053 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-fd6d42f2-2453-4e45-8eb9-4dfff3a677df tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 202 len: 0 microversion: 2.20 time: 0.284815 Nov 24 15:26:36.331660 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 376/809] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:26:36 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:26:36.340363 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-048a2378-6a58-4c6c-8aac-3beaf3418982 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:36.340976 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-048a2378-6a58-4c6c-8aac-3beaf3418982 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:36.347428 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-048a2378-6a58-4c6c-8aac-3beaf3418982 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:36.347947 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-048a2378-6a58-4c6c-8aac-3beaf3418982 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:36.348826 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-048a2378-6a58-4c6c-8aac-3beaf3418982 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:36.349338 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-048a2378-6a58-4c6c-8aac-3beaf3418982 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:36.484486 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-048a2378-6a58-4c6c-8aac-3beaf3418982 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:36.493000 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-048a2378-6a58-4c6c-8aac-3beaf3418982 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:36.494492 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-048a2378-6a58-4c6c-8aac-3beaf3418982 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:36.495674 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-048a2378-6a58-4c6c-8aac-3beaf3418982 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1721 microversion: 2.20 time: 0.159322 Nov 24 15:26:36.496240 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 434/810] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:36 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:37.516785 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-460b75fa-6398-41e5-abd1-6a8d4b9ceafc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:37.517399 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-460b75fa-6398-41e5-abd1-6a8d4b9ceafc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:37.524226 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-460b75fa-6398-41e5-abd1-6a8d4b9ceafc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:37.524672 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-460b75fa-6398-41e5-abd1-6a8d4b9ceafc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:37.525447 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-460b75fa-6398-41e5-abd1-6a8d4b9ceafc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:37.525877 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-460b75fa-6398-41e5-abd1-6a8d4b9ceafc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:37.659474 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-460b75fa-6398-41e5-abd1-6a8d4b9ceafc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:37.667141 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-460b75fa-6398-41e5-abd1-6a8d4b9ceafc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:37.668633 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-460b75fa-6398-41e5-abd1-6a8d4b9ceafc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:37.669810 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-460b75fa-6398-41e5-abd1-6a8d4b9ceafc tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1721 microversion: 2.20 time: 0.158206 Nov 24 15:26:37.670367 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 377/811] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:37 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:38.688404 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4ed83aef-7773-437b-bb12-ac4330229e3b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:38.689017 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4ed83aef-7773-437b-bb12-ac4330229e3b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:38.696093 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4ed83aef-7773-437b-bb12-ac4330229e3b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:38.696258 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4ed83aef-7773-437b-bb12-ac4330229e3b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:38.696985 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4ed83aef-7773-437b-bb12-ac4330229e3b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:38.697419 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4ed83aef-7773-437b-bb12-ac4330229e3b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:38.827523 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4ed83aef-7773-437b-bb12-ac4330229e3b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:38.836115 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4ed83aef-7773-437b-bb12-ac4330229e3b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:38.837672 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4ed83aef-7773-437b-bb12-ac4330229e3b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:38.838828 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4ed83aef-7773-437b-bb12-ac4330229e3b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1721 microversion: 2.20 time: 0.154098 Nov 24 15:26:38.839413 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 435/812] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:38 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:39.856520 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-48e1738a-b9eb-4b58-b92e-73e17ca2557e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:39.857120 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-48e1738a-b9eb-4b58-b92e-73e17ca2557e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:39.864252 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-48e1738a-b9eb-4b58-b92e-73e17ca2557e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:39.864368 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-48e1738a-b9eb-4b58-b92e-73e17ca2557e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:39.865069 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-48e1738a-b9eb-4b58-b92e-73e17ca2557e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:39.866134 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-48e1738a-b9eb-4b58-b92e-73e17ca2557e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:40.008987 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-48e1738a-b9eb-4b58-b92e-73e17ca2557e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:40.016730 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-48e1738a-b9eb-4b58-b92e-73e17ca2557e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:40.018220 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-48e1738a-b9eb-4b58-b92e-73e17ca2557e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:40.019397 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-48e1738a-b9eb-4b58-b92e-73e17ca2557e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1721 microversion: 2.20 time: 0.166505 Nov 24 15:26:40.019960 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 378/813] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:39 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:41.037640 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b1862e7c-5662-4d5f-ad8b-b8c851184ec4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:41.038252 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b1862e7c-5662-4d5f-ad8b-b8c851184ec4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:41.044085 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1862e7c-5662-4d5f-ad8b-b8c851184ec4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:41.044540 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1862e7c-5662-4d5f-ad8b-b8c851184ec4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:41.045361 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1862e7c-5662-4d5f-ad8b-b8c851184ec4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:41.045800 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1862e7c-5662-4d5f-ad8b-b8c851184ec4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:41.181583 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b1862e7c-5662-4d5f-ad8b-b8c851184ec4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:41.189187 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b1862e7c-5662-4d5f-ad8b-b8c851184ec4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:41.190688 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b1862e7c-5662-4d5f-ad8b-b8c851184ec4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:41.191843 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b1862e7c-5662-4d5f-ad8b-b8c851184ec4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1721 microversion: 2.20 time: 0.158335 Nov 24 15:26:41.192393 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 436/814] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:41 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:42.209015 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-7cfc27a6-a5d3-495d-a0f0-624e7929e9a0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:42.210224 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-7cfc27a6-a5d3-495d-a0f0-624e7929e9a0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:42.216376 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7cfc27a6-a5d3-495d-a0f0-624e7929e9a0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:42.216827 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7cfc27a6-a5d3-495d-a0f0-624e7929e9a0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:42.217609 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7cfc27a6-a5d3-495d-a0f0-624e7929e9a0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:42.218043 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7cfc27a6-a5d3-495d-a0f0-624e7929e9a0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:42.354494 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-7cfc27a6-a5d3-495d-a0f0-624e7929e9a0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:42.362626 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-7cfc27a6-a5d3-495d-a0f0-624e7929e9a0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:42.364404 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-7cfc27a6-a5d3-495d-a0f0-624e7929e9a0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:42.365685 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-7cfc27a6-a5d3-495d-a0f0-624e7929e9a0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1721 microversion: 2.20 time: 0.160276 Nov 24 15:26:42.366245 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 379/815] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:42 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:43.385916 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0bf8745e-7f81-4b47-aa11-078e154937d8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:43.386548 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0bf8745e-7f81-4b47-aa11-078e154937d8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:43.393213 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0bf8745e-7f81-4b47-aa11-078e154937d8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:43.393658 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0bf8745e-7f81-4b47-aa11-078e154937d8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:43.394430 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0bf8745e-7f81-4b47-aa11-078e154937d8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:43.394885 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0bf8745e-7f81-4b47-aa11-078e154937d8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:43.529748 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0bf8745e-7f81-4b47-aa11-078e154937d8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:43.539374 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0bf8745e-7f81-4b47-aa11-078e154937d8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:43.540963 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0bf8745e-7f81-4b47-aa11-078e154937d8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:43.542176 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0bf8745e-7f81-4b47-aa11-078e154937d8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1721 microversion: 2.20 time: 0.162098 Nov 24 15:26:43.543026 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 437/816] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:43 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:44.559909 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4b6327bb-b1c3-4a02-88bc-a318c1d1163e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:44.560571 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4b6327bb-b1c3-4a02-88bc-a318c1d1163e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:44.567250 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4b6327bb-b1c3-4a02-88bc-a318c1d1163e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:44.567700 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4b6327bb-b1c3-4a02-88bc-a318c1d1163e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:44.568481 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4b6327bb-b1c3-4a02-88bc-a318c1d1163e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:44.568915 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4b6327bb-b1c3-4a02-88bc-a318c1d1163e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:44.700974 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4b6327bb-b1c3-4a02-88bc-a318c1d1163e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:44.709871 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4b6327bb-b1c3-4a02-88bc-a318c1d1163e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:44.711567 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4b6327bb-b1c3-4a02-88bc-a318c1d1163e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:44.712904 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4b6327bb-b1c3-4a02-88bc-a318c1d1163e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1721 microversion: 2.20 time: 0.156757 Nov 24 15:26:44.713475 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 380/817] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:44 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:45.731409 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2689b6bc-9463-4e4a-973b-37fd5a091fc5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:45.731959 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2689b6bc-9463-4e4a-973b-37fd5a091fc5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:45.738621 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2689b6bc-9463-4e4a-973b-37fd5a091fc5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:45.739109 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2689b6bc-9463-4e4a-973b-37fd5a091fc5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:45.739882 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2689b6bc-9463-4e4a-973b-37fd5a091fc5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:45.740389 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2689b6bc-9463-4e4a-973b-37fd5a091fc5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:45.872647 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2689b6bc-9463-4e4a-973b-37fd5a091fc5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:45.880331 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2689b6bc-9463-4e4a-973b-37fd5a091fc5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:45.881797 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-2689b6bc-9463-4e4a-973b-37fd5a091fc5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:45.882952 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2689b6bc-9463-4e4a-973b-37fd5a091fc5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1721 microversion: 2.20 time: 0.155343 Nov 24 15:26:45.883510 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 438/818] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:45 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:46.900850 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a0366256-022e-46e6-bfca-8db718a682b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:46.901455 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a0366256-022e-46e6-bfca-8db718a682b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:46.907869 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a0366256-022e-46e6-bfca-8db718a682b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:46.908313 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a0366256-022e-46e6-bfca-8db718a682b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:46.909104 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a0366256-022e-46e6-bfca-8db718a682b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:46.909563 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a0366256-022e-46e6-bfca-8db718a682b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:47.041370 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-a0366256-022e-46e6-bfca-8db718a682b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:47.049630 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-a0366256-022e-46e6-bfca-8db718a682b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:47.051173 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-a0366256-022e-46e6-bfca-8db718a682b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:47.052358 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a0366256-022e-46e6-bfca-8db718a682b5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1721 microversion: 2.20 time: 0.155235 Nov 24 15:26:47.053417 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 381/819] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:46 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:48.037774 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3f6037ee-df73-47c8-ac71-709fad6d08ce tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:48.038302 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3f6037ee-df73-47c8-ac71-709fad6d08ce tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:48.043567 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-b51ac048-b0e2-4ae6-ab4b-498f1e90a5cc req-c54cc0d6-0ac1-4364-b506-cca870843f7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97e7745-6b55-46b5-a651-17bc3a3bdbc9", "tag": "00062239-b32a-4c2a-9fb5-f6a38539f917"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:48.045119 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:26:48.045119 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:26:48.054996 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f6037ee-df73-47c8-ac71-709fad6d08ce tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:48.055444 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f6037ee-df73-47c8-ac71-709fad6d08ce tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:48.056004 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-b51ac048-b0e2-4ae6-ab4b-498f1e90a5cc req-c54cc0d6-0ac1-4364-b506-cca870843f7f service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:48.056238 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f6037ee-df73-47c8-ac71-709fad6d08ce tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:48.056574 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-b51ac048-b0e2-4ae6-ab4b-498f1e90a5cc req-c54cc0d6-0ac1-4364-b506-cca870843f7f service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:48.056702 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f6037ee-df73-47c8-ac71-709fad6d08ce tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:48.067831 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-b51ac048-b0e2-4ae6-ab4b-498f1e90a5cc req-c54cc0d6-0ac1-4364-b506-cca870843f7f service nova] Creating event network-changed:00062239-b32a-4c2a-9fb5-f6a38539f917 for instance b97e7745-6b55-46b5-a651-17bc3a3bdbc9 on hv-cinder-80403 Nov 24 15:26:48.073290 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-b51ac048-b0e2-4ae6-ab4b-498f1e90a5cc req-c54cc0d6-0ac1-4364-b506-cca870843f7f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033127 Nov 24 15:26:48.074084 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 382/820] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:26:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:26:48.078756 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4c336446-8465-43eb-9ddc-eeda2783038e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:48.079472 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4c336446-8465-43eb-9ddc-eeda2783038e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:48.086632 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4c336446-8465-43eb-9ddc-eeda2783038e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:48.087271 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4c336446-8465-43eb-9ddc-eeda2783038e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:48.087584 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3f6037ee-df73-47c8-ac71-709fad6d08ce tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:26:48.088076 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4c336446-8465-43eb-9ddc-eeda2783038e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:48.088521 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4c336446-8465-43eb-9ddc-eeda2783038e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:48.196141 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3f6037ee-df73-47c8-ac71-709fad6d08ce tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 204 len: 0 microversion: 2.1 time: 0.159600 Nov 24 15:26:48.199867 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 439/821] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:26:48 2021] DELETE /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:26:48.208315 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e4a09a9b-f20e-4f6b-ab30-d2850a25643e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:48.215459 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e4a09a9b-f20e-4f6b-ab30-d2850a25643e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:48.228707 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e4a09a9b-f20e-4f6b-ab30-d2850a25643e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:48.230186 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e4a09a9b-f20e-4f6b-ab30-d2850a25643e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:48.231575 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e4a09a9b-f20e-4f6b-ab30-d2850a25643e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:48.232216 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e4a09a9b-f20e-4f6b-ab30-d2850a25643e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:48.276579 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4c336446-8465-43eb-9ddc-eeda2783038e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:48.284950 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4c336446-8465-43eb-9ddc-eeda2783038e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:48.286447 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4c336446-8465-43eb-9ddc-eeda2783038e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:48.288406 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4c336446-8465-43eb-9ddc-eeda2783038e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1721 microversion: 2.20 time: 0.213434 Nov 24 15:26:48.299791 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 383/822] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:48 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1721 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:48.399715 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e4a09a9b-f20e-4f6b-ab30-d2850a25643e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:48.411305 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e4a09a9b-f20e-4f6b-ab30-d2850a25643e tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1568 microversion: 2.1 time: 0.208942 Nov 24 15:26:48.412832 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 440/823] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:26:48 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:26:49.307232 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-0c5aa05c-a9e3-4517-879d-aaf63be59b27 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:49.307838 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-0c5aa05c-a9e3-4517-879d-aaf63be59b27 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:49.314162 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0c5aa05c-a9e3-4517-879d-aaf63be59b27 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:49.314645 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0c5aa05c-a9e3-4517-879d-aaf63be59b27 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:49.315475 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0c5aa05c-a9e3-4517-879d-aaf63be59b27 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:49.315905 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0c5aa05c-a9e3-4517-879d-aaf63be59b27 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:49.429806 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-31c641c2-b7c4-42c6-bc3d-949082555458 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:49.430527 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-31c641c2-b7c4-42c6-bc3d-949082555458 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:49.436943 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31c641c2-b7c4-42c6-bc3d-949082555458 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:49.437491 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31c641c2-b7c4-42c6-bc3d-949082555458 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:49.438352 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31c641c2-b7c4-42c6-bc3d-949082555458 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:49.438894 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-31c641c2-b7c4-42c6-bc3d-949082555458 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:49.447686 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-0c5aa05c-a9e3-4517-879d-aaf63be59b27 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:49.458473 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-0c5aa05c-a9e3-4517-879d-aaf63be59b27 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:49.460885 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-0c5aa05c-a9e3-4517-879d-aaf63be59b27 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:49.462472 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-0c5aa05c-a9e3-4517-879d-aaf63be59b27 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1742 microversion: 2.20 time: 0.158954 Nov 24 15:26:49.463197 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 384/824] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:49 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:49.580786 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-31c641c2-b7c4-42c6-bc3d-949082555458 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:49.588249 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-31c641c2-b7c4-42c6-bc3d-949082555458 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1449 microversion: 2.1 time: 0.162742 Nov 24 15:26:49.588823 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 441/825] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:26:49 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1449 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:26:50.230031 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-81fcfe9c-779c-4d11-bdcd-c3d7a21d72a4 req-9ee5ffc8-35df-4ff6-8037-da95445de0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97e7745-6b55-46b5-a651-17bc3a3bdbc9", "name": "network-vif-deleted", "tag": "00062239-b32a-4c2a-9fb5-f6a38539f917"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:50.231921 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:26:50.231921 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:26:50.238784 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-81fcfe9c-779c-4d11-bdcd-c3d7a21d72a4 req-9ee5ffc8-35df-4ff6-8037-da95445de0e9 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:50.239248 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-81fcfe9c-779c-4d11-bdcd-c3d7a21d72a4 req-9ee5ffc8-35df-4ff6-8037-da95445de0e9 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:50.250865 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-81fcfe9c-779c-4d11-bdcd-c3d7a21d72a4 req-9ee5ffc8-35df-4ff6-8037-da95445de0e9 service nova] Creating event network-vif-deleted:00062239-b32a-4c2a-9fb5-f6a38539f917 for instance b97e7745-6b55-46b5-a651-17bc3a3bdbc9 on hv-cinder-80403 Nov 24 15:26:50.256521 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-81fcfe9c-779c-4d11-bdcd-c3d7a21d72a4 req-9ee5ffc8-35df-4ff6-8037-da95445de0e9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029315 Nov 24 15:26:50.257141 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 385/826] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:26:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:26:50.482697 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4b49a548-d0a6-4fc6-8b29-331a44a1ad44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:50.483590 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4b49a548-d0a6-4fc6-8b29-331a44a1ad44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:50.492010 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4b49a548-d0a6-4fc6-8b29-331a44a1ad44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:50.493116 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4b49a548-d0a6-4fc6-8b29-331a44a1ad44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:50.494292 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4b49a548-d0a6-4fc6-8b29-331a44a1ad44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:50.494948 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4b49a548-d0a6-4fc6-8b29-331a44a1ad44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:50.606499 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a99101b4-4041-480d-97ad-f20ac17ea642 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:50.607296 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a99101b4-4041-480d-97ad-f20ac17ea642 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:50.614384 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a99101b4-4041-480d-97ad-f20ac17ea642 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:50.615253 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a99101b4-4041-480d-97ad-f20ac17ea642 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:50.616118 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a99101b4-4041-480d-97ad-f20ac17ea642 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:50.616772 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a99101b4-4041-480d-97ad-f20ac17ea642 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:50.663718 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a99101b4-4041-480d-97ad-f20ac17ea642 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:50.664179 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a99101b4-4041-480d-97ad-f20ac17ea642 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:50.664635 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-a99101b4-4041-480d-97ad-f20ac17ea642 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lazy-loading 'fault' on Instance uuid b97e7745-6b55-46b5-a651-17bc3a3bdbc9 {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:26:50.664759 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4b49a548-d0a6-4fc6-8b29-331a44a1ad44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:50.673875 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4b49a548-d0a6-4fc6-8b29-331a44a1ad44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:50.675620 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4b49a548-d0a6-4fc6-8b29-331a44a1ad44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:50.677060 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4b49a548-d0a6-4fc6-8b29-331a44a1ad44 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1742 microversion: 2.20 time: 0.199329 Nov 24 15:26:50.677843 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 442/827] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:50 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1742 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:50.705521 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-a99101b4-4041-480d-97ad-f20ac17ea642 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:50.714043 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a99101b4-4041-480d-97ad-f20ac17ea642 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1224 microversion: 2.1 time: 0.111738 Nov 24 15:26:50.714672 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 386/828] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:26:50 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1224 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:26:51.695318 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-69a26a85-4cfd-422f-8a55-4e264c28562e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:51.695923 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-69a26a85-4cfd-422f-8a55-4e264c28562e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:51.702255 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69a26a85-4cfd-422f-8a55-4e264c28562e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:51.702701 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69a26a85-4cfd-422f-8a55-4e264c28562e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:51.703501 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69a26a85-4cfd-422f-8a55-4e264c28562e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:51.703935 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69a26a85-4cfd-422f-8a55-4e264c28562e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:51.730686 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c4b6c808-d30b-4c44-935a-5c51811d1fd2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:51.731319 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c4b6c808-d30b-4c44-935a-5c51811d1fd2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:51.737876 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c4b6c808-d30b-4c44-935a-5c51811d1fd2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:51.738701 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c4b6c808-d30b-4c44-935a-5c51811d1fd2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:51.739423 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c4b6c808-d30b-4c44-935a-5c51811d1fd2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:51.739833 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c4b6c808-d30b-4c44-935a-5c51811d1fd2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:51.771137 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c4b6c808-d30b-4c44-935a-5c51811d1fd2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:51.771584 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c4b6c808-d30b-4c44-935a-5c51811d1fd2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:51.772227 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-c4b6c808-d30b-4c44-935a-5c51811d1fd2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lazy-loading 'fault' on Instance uuid b97e7745-6b55-46b5-a651-17bc3a3bdbc9 {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:26:51.828976 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c4b6c808-d30b-4c44-935a-5c51811d1fd2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:51.836584 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c4b6c808-d30b-4c44-935a-5c51811d1fd2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1224 microversion: 2.1 time: 0.109436 Nov 24 15:26:51.837358 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 387/829] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:26:51 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1224 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:26:51.858082 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-69a26a85-4cfd-422f-8a55-4e264c28562e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:51.866672 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-69a26a85-4cfd-422f-8a55-4e264c28562e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:51.868245 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-69a26a85-4cfd-422f-8a55-4e264c28562e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:51.869459 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-69a26a85-4cfd-422f-8a55-4e264c28562e tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1742 microversion: 2.20 time: 0.178023 Nov 24 15:26:51.870105 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 443/830] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:51 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1742 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:52.853271 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c2aec4ac-8e93-49c9-8fc0-d292c8f03943 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:52.853804 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c2aec4ac-8e93-49c9-8fc0-d292c8f03943 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:52.860047 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c2aec4ac-8e93-49c9-8fc0-d292c8f03943 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:52.860490 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c2aec4ac-8e93-49c9-8fc0-d292c8f03943 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:52.861256 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c2aec4ac-8e93-49c9-8fc0-d292c8f03943 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:52.861688 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c2aec4ac-8e93-49c9-8fc0-d292c8f03943 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:52.887564 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-84106eb2-8e31-4b74-aeb0-7c43e2c6f6a5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:52.888172 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-84106eb2-8e31-4b74-aeb0-7c43e2c6f6a5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:52.892608 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c2aec4ac-8e93-49c9-8fc0-d292c8f03943 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:52.893057 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c2aec4ac-8e93-49c9-8fc0-d292c8f03943 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:52.893494 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-c2aec4ac-8e93-49c9-8fc0-d292c8f03943 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lazy-loading 'fault' on Instance uuid b97e7745-6b55-46b5-a651-17bc3a3bdbc9 {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:26:52.894302 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84106eb2-8e31-4b74-aeb0-7c43e2c6f6a5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:52.894750 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84106eb2-8e31-4b74-aeb0-7c43e2c6f6a5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:52.895555 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84106eb2-8e31-4b74-aeb0-7c43e2c6f6a5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:52.895988 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84106eb2-8e31-4b74-aeb0-7c43e2c6f6a5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:52.933820 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c2aec4ac-8e93-49c9-8fc0-d292c8f03943 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fbd637c599f4ba6ba3fa26a892c02a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a89a75844197496785d27fd3e412344c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:52.942063 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c2aec4ac-8e93-49c9-8fc0-d292c8f03943 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 200 len: 1224 microversion: 2.1 time: 0.092529 Nov 24 15:26:52.942640 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 388/831] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:26:52 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:26:53.032562 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-84106eb2-8e31-4b74-aeb0-7c43e2c6f6a5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:53.040180 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-84106eb2-8e31-4b74-aeb0-7c43e2c6f6a5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:53.041651 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-84106eb2-8e31-4b74-aeb0-7c43e2c6f6a5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:53.042787 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-84106eb2-8e31-4b74-aeb0-7c43e2c6f6a5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1742 microversion: 2.20 time: 0.158844 Nov 24 15:26:53.043361 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 444/832] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:52 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1742 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:26:53.960465 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c50f7d91-b133-459c-b4e1-9ac1dd5f3371 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:53.961064 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c50f7d91-b133-459c-b4e1-9ac1dd5f3371 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] [instance: b97e7745-6b55-46b5-a651-17bc3a3bdbc9] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:53.968253 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c50f7d91-b133-459c-b4e1-9ac1dd5f3371 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:53.968807 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c50f7d91-b133-459c-b4e1-9ac1dd5f3371 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:53.970476 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c50f7d91-b133-459c-b4e1-9ac1dd5f3371 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:53.971038 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c50f7d91-b133-459c-b4e1-9ac1dd5f3371 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:53.986458 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-c50f7d91-b133-459c-b4e1-9ac1dd5f3371 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] HTTP exception thrown: Instance b97e7745-6b55-46b5-a651-17bc3a3bdbc9 could not be found. Nov 24 15:26:53.987143 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c50f7d91-b133-459c-b4e1-9ac1dd5f3371 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Returning 404 to user: Instance b97e7745-6b55-46b5-a651-17bc3a3bdbc9 could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:26:53.988151 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c50f7d91-b133-459c-b4e1-9ac1dd5f3371 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9" status: 404 len: 111 microversion: 2.1 time: 0.031866 Nov 24 15:26:53.989083 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 389/833] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:26:53 2021] GET /compute/v2.1/servers/b97e7745-6b55-46b5-a651-17bc3a3bdbc9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:26:54.066426 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c544170a-3d2a-4574-91f9-5a29483ead45 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:54.067931 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c544170a-3d2a-4574-91f9-5a29483ead45 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:54.078062 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c544170a-3d2a-4574-91f9-5a29483ead45 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:54.078902 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c544170a-3d2a-4574-91f9-5a29483ead45 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:54.079794 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c544170a-3d2a-4574-91f9-5a29483ead45 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:54.080225 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c544170a-3d2a-4574-91f9-5a29483ead45 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:54.183299 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6a219fe3-ba80-4459-94ae-673f37e81ad2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] Calling method '.version_select at 0x7f930cb44af0>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:54.206320 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6a219fe3-ba80-4459-94ae-673f37e81ad2 tempest-TestShelveInstance-1039072450 tempest-TestShelveInstance-1039072450-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-145177780" status: 202 len: 0 microversion: 2.1 time: 0.027637 Nov 24 15:26:54.207974 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 390/834] 10.222.0.66 () {58 vars in 1250 bytes} [Wed Nov 24 15:26:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-145177780 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 15:26:54.277162 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c544170a-3d2a-4574-91f9-5a29483ead45 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:54.287692 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c544170a-3d2a-4574-91f9-5a29483ead45 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:54.290142 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c544170a-3d2a-4574-91f9-5a29483ead45 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:54.291417 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c544170a-3d2a-4574-91f9-5a29483ead45 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1737 microversion: 2.20 time: 0.232135 Nov 24 15:26:54.292241 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 445/835] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:54 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:26:55.310524 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-e52b2961-30c8-4697-b2a0-e48ef1a549a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:55.311277 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-e52b2961-30c8-4697-b2a0-e48ef1a549a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:55.320825 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e52b2961-30c8-4697-b2a0-e48ef1a549a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:55.321427 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e52b2961-30c8-4697-b2a0-e48ef1a549a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:55.322527 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e52b2961-30c8-4697-b2a0-e48ef1a549a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:55.323145 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e52b2961-30c8-4697-b2a0-e48ef1a549a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:55.524236 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e52b2961-30c8-4697-b2a0-e48ef1a549a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:55.542073 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e52b2961-30c8-4697-b2a0-e48ef1a549a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:55.547132 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e52b2961-30c8-4697-b2a0-e48ef1a549a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:55.548811 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-e52b2961-30c8-4697-b2a0-e48ef1a549a2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1737 microversion: 2.20 time: 0.242149 Nov 24 15:26:55.559280 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 391/836] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:55 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:55.847784 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-34501f17-b8d7-4c85-9aa4-e79feb8f0a83 req-de58a903-acb1-4702-9fc3-9a674e7dfd44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68310acb-6f2f-4a32-9b65-20ae91f67062", "name": "network-vif-plugged", "status": "completed", "tag": "071fb078-3f83-4604-a050-d36e5c042f5f"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:55.850167 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:26:55.850167 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:26:55.868822 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-34501f17-b8d7-4c85-9aa4-e79feb8f0a83 req-de58a903-acb1-4702-9fc3-9a674e7dfd44 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:55.871487 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-34501f17-b8d7-4c85-9aa4-e79feb8f0a83 req-de58a903-acb1-4702-9fc3-9a674e7dfd44 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:55.900018 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-34501f17-b8d7-4c85-9aa4-e79feb8f0a83 req-de58a903-acb1-4702-9fc3-9a674e7dfd44 service nova] Creating event network-vif-plugged:071fb078-3f83-4604-a050-d36e5c042f5f for instance 68310acb-6f2f-4a32-9b65-20ae91f67062 on hv-cinder-80403 Nov 24 15:26:55.913869 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-34501f17-b8d7-4c85-9aa4-e79feb8f0a83 req-de58a903-acb1-4702-9fc3-9a674e7dfd44 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072580 Nov 24 15:26:55.914801 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 446/837] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:26:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:26:56.568959 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-5f2ad99d-61ed-46c3-af50-877b79917f5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:56.570127 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-5f2ad99d-61ed-46c3-af50-877b79917f5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:56.592158 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5f2ad99d-61ed-46c3-af50-877b79917f5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:56.592706 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5f2ad99d-61ed-46c3-af50-877b79917f5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:56.593595 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5f2ad99d-61ed-46c3-af50-877b79917f5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:56.594031 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5f2ad99d-61ed-46c3-af50-877b79917f5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:56.803459 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-5f2ad99d-61ed-46c3-af50-877b79917f5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:56.815059 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-5f2ad99d-61ed-46c3-af50-877b79917f5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:56.817692 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-5f2ad99d-61ed-46c3-af50-877b79917f5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:56.819675 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-5f2ad99d-61ed-46c3-af50-877b79917f5c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1737 microversion: 2.20 time: 0.254971 Nov 24 15:26:56.820806 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 392/838] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:56 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1737 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:57.842073 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-618c3c22-eb9d-4e5f-8396-7f3a838b547f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:57.844683 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-618c3c22-eb9d-4e5f-8396-7f3a838b547f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:57.862231 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-618c3c22-eb9d-4e5f-8396-7f3a838b547f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:57.863595 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-618c3c22-eb9d-4e5f-8396-7f3a838b547f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:57.864546 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-618c3c22-eb9d-4e5f-8396-7f3a838b547f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:57.865662 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-618c3c22-eb9d-4e5f-8396-7f3a838b547f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:58.119615 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-618c3c22-eb9d-4e5f-8396-7f3a838b547f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:58.137004 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-618c3c22-eb9d-4e5f-8396-7f3a838b547f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:58.140222 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-618c3c22-eb9d-4e5f-8396-7f3a838b547f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:58.148363 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-618c3c22-eb9d-4e5f-8396-7f3a838b547f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1737 microversion: 2.20 time: 0.309620 Nov 24 15:26:58.152957 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 447/839] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:57 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1737 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:26:58.394827 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1272010752", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1044302524", "security_groups": [{"name": "tempest-secgroup-smoke-1039673694"}], "block_device_mapping_v2": [{"uuid": "f7a6e306-8bce-4264-b071-729962fa7884", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f26750e4-e797-4f7f-b557-e7463bad5d42"}]}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:26:58.604437 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.network.neutron [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] validate_networks() for [('f26750e4-e797-4f7f-b557-e7463bad5d42', None, None, None, None, None)] {{(pid=116073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:26:59.154274 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Flavor limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:26:59.154702 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Image limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:26:59.155206 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Flavor pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:26:59.155618 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Image pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:26:59.156031 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:26:59.171042 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6d3738ec-40a3-44e6-9b64-7104e750e73b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:59.172280 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6d3738ec-40a3-44e6-9b64-7104e750e73b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:59.183452 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6d3738ec-40a3-44e6-9b64-7104e750e73b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:59.184172 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6d3738ec-40a3-44e6-9b64-7104e750e73b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:59.185188 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6d3738ec-40a3-44e6-9b64-7104e750e73b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:59.185776 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6d3738ec-40a3-44e6-9b64-7104e750e73b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:59.188922 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:59.189714 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:59.190711 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:26:59.191203 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:26:59.235515 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Getting quotas for project b981a3c2d7974c7ca0c54a5262ea5220. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:26:59.255965 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Getting quotas for user ad76e9906e5341869af05aace8368403 and project b981a3c2d7974c7ca0c54a5262ea5220. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:26:59.365268 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Going to run 1 instances... {{(pid=116073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:26:59.367461 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f7a6e306-8bce-4264-b071-729962fa7884',volume_size=None,volume_type=None)] {{(pid=116073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:26:59.419427 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6d3738ec-40a3-44e6-9b64-7104e750e73b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:59.435851 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6d3738ec-40a3-44e6-9b64-7104e750e73b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:59.437676 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6d3738ec-40a3-44e6-9b64-7104e750e73b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:59.439126 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6d3738ec-40a3-44e6-9b64-7104e750e73b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1737 microversion: 2.20 time: 0.272348 Nov 24 15:26:59.450854 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 448/840] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:26:59 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1737 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:26:59.541105 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-fc739d79-48d8-4e1f-beb0-86aa354ff87a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.150826 Nov 24 15:26:59.542915 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 393/841] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:26:58 2021] POST /compute/v2.1/servers => generated 406 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 15:26:59.552491 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-afda7eb2-9523-4af2-93c7-b5032728f77c tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:26:59.553097 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-afda7eb2-9523-4af2-93c7-b5032728f77c tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:26:59.638314 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-afda7eb2-9523-4af2-93c7-b5032728f77c tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:26:59.648419 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-afda7eb2-9523-4af2-93c7-b5032728f77c tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1095 microversion: 2.1 time: 0.098347 Nov 24 15:26:59.651653 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 449/842] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:26:59 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1095 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:27:00.457284 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-7465e716-3dd5-44c0-93fb-8096b63277e0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:00.457891 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-7465e716-3dd5-44c0-93fb-8096b63277e0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:00.469356 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7465e716-3dd5-44c0-93fb-8096b63277e0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:00.471160 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7465e716-3dd5-44c0-93fb-8096b63277e0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:00.472208 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7465e716-3dd5-44c0-93fb-8096b63277e0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:00.472819 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7465e716-3dd5-44c0-93fb-8096b63277e0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:00.667719 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-adcee9c7-ada9-4d7c-8ad8-24d6c260eb87 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:00.669028 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-adcee9c7-ada9-4d7c-8ad8-24d6c260eb87 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:00.679279 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-adcee9c7-ada9-4d7c-8ad8-24d6c260eb87 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:00.680749 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-adcee9c7-ada9-4d7c-8ad8-24d6c260eb87 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:00.683142 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-adcee9c7-ada9-4d7c-8ad8-24d6c260eb87 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:00.685179 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-adcee9c7-ada9-4d7c-8ad8-24d6c260eb87 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:00.701208 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-7465e716-3dd5-44c0-93fb-8096b63277e0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:00.721274 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-7465e716-3dd5-44c0-93fb-8096b63277e0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:00.726543 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-7465e716-3dd5-44c0-93fb-8096b63277e0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:00.733651 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-7465e716-3dd5-44c0-93fb-8096b63277e0 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1737 microversion: 2.20 time: 0.277285 Nov 24 15:27:00.749934 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 394/843] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:00 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1737 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:00.766386 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-adcee9c7-ada9-4d7c-8ad8-24d6c260eb87 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:00.775749 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-adcee9c7-ada9-4d7c-8ad8-24d6c260eb87 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1193 microversion: 2.1 time: 0.112647 Nov 24 15:27:00.787197 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 450/844] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:00 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1193 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:27:01.755147 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-1c635f63-1e90-4b49-a2ef-7300d9ac02ed tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:01.756437 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-1c635f63-1e90-4b49-a2ef-7300d9ac02ed tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:01.763292 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1c635f63-1e90-4b49-a2ef-7300d9ac02ed tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:01.763995 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1c635f63-1e90-4b49-a2ef-7300d9ac02ed tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:01.764964 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1c635f63-1e90-4b49-a2ef-7300d9ac02ed tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:01.765584 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1c635f63-1e90-4b49-a2ef-7300d9ac02ed tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:01.797191 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-495c93de-c77b-4d8f-bce3-a633418f2a69 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:01.798215 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-495c93de-c77b-4d8f-bce3-a633418f2a69 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:01.810097 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-495c93de-c77b-4d8f-bce3-a633418f2a69 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:01.816809 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-495c93de-c77b-4d8f-bce3-a633418f2a69 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:01.818219 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-495c93de-c77b-4d8f-bce3-a633418f2a69 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:01.824713 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-495c93de-c77b-4d8f-bce3-a633418f2a69 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:02.225524 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-495c93de-c77b-4d8f-bce3-a633418f2a69 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:02.234641 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-495c93de-c77b-4d8f-bce3-a633418f2a69 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1199 microversion: 2.1 time: 0.441234 Nov 24 15:27:02.253776 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 451/845] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:01 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1199 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:27:02.296761 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-1c635f63-1e90-4b49-a2ef-7300d9ac02ed tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:02.306694 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-1c635f63-1e90-4b49-a2ef-7300d9ac02ed tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:02.308466 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-1c635f63-1e90-4b49-a2ef-7300d9ac02ed tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:02.309817 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-1c635f63-1e90-4b49-a2ef-7300d9ac02ed tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1737 microversion: 2.20 time: 0.558289 Nov 24 15:27:02.310861 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 395/846] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:01 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1737 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:03.262116 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4dea1441-fc98-4ccd-96ce-9c0ec253bc0f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:03.263326 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4dea1441-fc98-4ccd-96ce-9c0ec253bc0f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:03.282452 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4dea1441-fc98-4ccd-96ce-9c0ec253bc0f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:03.284418 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4dea1441-fc98-4ccd-96ce-9c0ec253bc0f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:03.285455 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4dea1441-fc98-4ccd-96ce-9c0ec253bc0f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:03.286058 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4dea1441-fc98-4ccd-96ce-9c0ec253bc0f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:03.330265 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c1b0ff50-34eb-4d48-9d1f-1c996ecd1fef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:03.332197 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c1b0ff50-34eb-4d48-9d1f-1c996ecd1fef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:03.342338 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c1b0ff50-34eb-4d48-9d1f-1c996ecd1fef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:03.354527 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c1b0ff50-34eb-4d48-9d1f-1c996ecd1fef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:03.355709 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c1b0ff50-34eb-4d48-9d1f-1c996ecd1fef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:03.359987 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c1b0ff50-34eb-4d48-9d1f-1c996ecd1fef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:03.768825 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4dea1441-fc98-4ccd-96ce-9c0ec253bc0f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:03.777744 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4dea1441-fc98-4ccd-96ce-9c0ec253bc0f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.519771 Nov 24 15:27:03.778573 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 452/847] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:03 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:27:03.785045 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-5eac33f8-082b-42d3-aefc-09c75a8de800 req-46a65d64-5a34-442a-a460-8c95eeb73bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b89769a5-ef2a-400a-9c59-3053f647e3c2", "tag": "2acc53e6-5fad-45de-9695-638ed83c9206"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:27:03.792496 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:27:03.792496 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:27:03.804777 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-5eac33f8-082b-42d3-aefc-09c75a8de800 req-46a65d64-5a34-442a-a460-8c95eeb73bc9 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:03.805287 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-5eac33f8-082b-42d3-aefc-09c75a8de800 req-46a65d64-5a34-442a-a460-8c95eeb73bc9 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:03.827087 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c1b0ff50-34eb-4d48-9d1f-1c996ecd1fef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:03.839086 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c1b0ff50-34eb-4d48-9d1f-1c996ecd1fef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:03.840605 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c1b0ff50-34eb-4d48-9d1f-1c996ecd1fef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:03.841780 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c1b0ff50-34eb-4d48-9d1f-1c996ecd1fef tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1737 microversion: 2.20 time: 0.516731 Nov 24 15:27:03.842534 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 396/848] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:03 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1737 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:03.844715 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-5eac33f8-082b-42d3-aefc-09c75a8de800 req-46a65d64-5a34-442a-a460-8c95eeb73bc9 service nova] Creating event network-changed:2acc53e6-5fad-45de-9695-638ed83c9206 for instance b89769a5-ef2a-400a-9c59-3053f647e3c2 on hv-cinder-80403 Nov 24 15:27:03.854583 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-5eac33f8-082b-42d3-aefc-09c75a8de800 req-46a65d64-5a34-442a-a460-8c95eeb73bc9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073837 Nov 24 15:27:03.855588 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 453/849] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:27:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:27:04.794929 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-778fe133-78a1-4efe-a1ba-95aeabc5b52f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:04.795542 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-778fe133-78a1-4efe-a1ba-95aeabc5b52f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:04.809313 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-778fe133-78a1-4efe-a1ba-95aeabc5b52f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:04.809948 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-778fe133-78a1-4efe-a1ba-95aeabc5b52f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:04.810846 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-778fe133-78a1-4efe-a1ba-95aeabc5b52f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:04.811562 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-778fe133-78a1-4efe-a1ba-95aeabc5b52f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:04.860651 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ca959b74-7f3a-4940-a473-bd751ce70749 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:04.861436 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ca959b74-7f3a-4940-a473-bd751ce70749 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:04.868845 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ca959b74-7f3a-4940-a473-bd751ce70749 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:04.868845 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ca959b74-7f3a-4940-a473-bd751ce70749 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:04.869753 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ca959b74-7f3a-4940-a473-bd751ce70749 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:04.870254 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ca959b74-7f3a-4940-a473-bd751ce70749 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:05.076762 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-778fe133-78a1-4efe-a1ba-95aeabc5b52f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:05.089456 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-778fe133-78a1-4efe-a1ba-95aeabc5b52f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.298117 Nov 24 15:27:05.099097 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 397/850] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:04 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:27:05.126350 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ca959b74-7f3a-4940-a473-bd751ce70749 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:05.135620 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ca959b74-7f3a-4940-a473-bd751ce70749 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:05.137262 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ca959b74-7f3a-4940-a473-bd751ce70749 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:05.138532 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ca959b74-7f3a-4940-a473-bd751ce70749 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1737 microversion: 2.20 time: 0.282301 Nov 24 15:27:05.139559 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 454/851] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:04 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1737 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:27:06.105366 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c5b11785-97ff-4a50-8a0e-02c252bbfca4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:06.107243 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c5b11785-97ff-4a50-8a0e-02c252bbfca4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:06.114474 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c5b11785-97ff-4a50-8a0e-02c252bbfca4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:06.115058 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c5b11785-97ff-4a50-8a0e-02c252bbfca4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:06.116027 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c5b11785-97ff-4a50-8a0e-02c252bbfca4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:06.116471 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c5b11785-97ff-4a50-8a0e-02c252bbfca4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:06.157318 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-84776eea-0a9d-4621-86e0-3410037b5c83 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:06.165896 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-84776eea-0a9d-4621-86e0-3410037b5c83 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:06.173098 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84776eea-0a9d-4621-86e0-3410037b5c83 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:06.173684 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84776eea-0a9d-4621-86e0-3410037b5c83 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:06.174477 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84776eea-0a9d-4621-86e0-3410037b5c83 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:06.174941 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84776eea-0a9d-4621-86e0-3410037b5c83 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:06.305986 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c5b11785-97ff-4a50-8a0e-02c252bbfca4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:06.314050 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c5b11785-97ff-4a50-8a0e-02c252bbfca4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.212327 Nov 24 15:27:06.314894 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 398/852] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:06 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:27:06.391065 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-84776eea-0a9d-4621-86e0-3410037b5c83 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:06.399181 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-84776eea-0a9d-4621-86e0-3410037b5c83 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:06.400732 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-84776eea-0a9d-4621-86e0-3410037b5c83 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:06.402010 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-84776eea-0a9d-4621-86e0-3410037b5c83 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1737 microversion: 2.20 time: 0.248418 Nov 24 15:27:06.402645 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 455/853] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:06 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1737 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:07.331619 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-25349f0c-b365-4713-9c3c-486c672bfe56 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:07.332256 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-25349f0c-b365-4713-9c3c-486c672bfe56 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:07.339482 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-25349f0c-b365-4713-9c3c-486c672bfe56 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:07.339860 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-25349f0c-b365-4713-9c3c-486c672bfe56 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:07.340645 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-25349f0c-b365-4713-9c3c-486c672bfe56 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:07.341084 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-25349f0c-b365-4713-9c3c-486c672bfe56 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:07.420413 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f64b7dc2-9f22-4c30-84d6-3f11eb0600f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:07.421045 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f64b7dc2-9f22-4c30-84d6-3f11eb0600f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:07.427338 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f64b7dc2-9f22-4c30-84d6-3f11eb0600f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:07.428114 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f64b7dc2-9f22-4c30-84d6-3f11eb0600f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:07.429872 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f64b7dc2-9f22-4c30-84d6-3f11eb0600f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:07.430315 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f64b7dc2-9f22-4c30-84d6-3f11eb0600f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:07.483194 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-25349f0c-b365-4713-9c3c-486c672bfe56 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:07.491166 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-25349f0c-b365-4713-9c3c-486c672bfe56 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.163126 Nov 24 15:27:07.491744 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 399/854] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:07 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:27:07.568884 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f64b7dc2-9f22-4c30-84d6-3f11eb0600f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:07.576446 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f64b7dc2-9f22-4c30-84d6-3f11eb0600f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:07.577909 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f64b7dc2-9f22-4c30-84d6-3f11eb0600f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:07.579066 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f64b7dc2-9f22-4c30-84d6-3f11eb0600f6 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1719 microversion: 2.20 time: 0.162429 Nov 24 15:27:07.579872 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 456/855] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:07 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:27:08.507634 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a75c3e06-0997-4678-9a53-c2c60f010c13 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:08.508242 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a75c3e06-0997-4678-9a53-c2c60f010c13 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:08.514604 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a75c3e06-0997-4678-9a53-c2c60f010c13 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:08.515104 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a75c3e06-0997-4678-9a53-c2c60f010c13 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:08.515894 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a75c3e06-0997-4678-9a53-c2c60f010c13 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:08.516338 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a75c3e06-0997-4678-9a53-c2c60f010c13 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:08.597911 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d52908d4-3156-4410-b3c8-da8096d81d51 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:08.598537 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d52908d4-3156-4410-b3c8-da8096d81d51 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:08.605488 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d52908d4-3156-4410-b3c8-da8096d81d51 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:08.605932 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d52908d4-3156-4410-b3c8-da8096d81d51 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:08.606717 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d52908d4-3156-4410-b3c8-da8096d81d51 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:08.607179 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d52908d4-3156-4410-b3c8-da8096d81d51 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:08.660750 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-a75c3e06-0997-4678-9a53-c2c60f010c13 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:08.668871 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a75c3e06-0997-4678-9a53-c2c60f010c13 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.164918 Nov 24 15:27:08.669444 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 400/856] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:08 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:27:08.745534 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d52908d4-3156-4410-b3c8-da8096d81d51 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:08.753172 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d52908d4-3156-4410-b3c8-da8096d81d51 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:08.754655 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d52908d4-3156-4410-b3c8-da8096d81d51 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:08.755843 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d52908d4-3156-4410-b3c8-da8096d81d51 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1719 microversion: 2.20 time: 0.162301 Nov 24 15:27:08.756682 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 457/857] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:08 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:27:09.685321 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c3201991-3b73-4a58-bcf0-c4928e04277e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:09.685952 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c3201991-3b73-4a58-bcf0-c4928e04277e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:09.692170 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c3201991-3b73-4a58-bcf0-c4928e04277e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:09.692613 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c3201991-3b73-4a58-bcf0-c4928e04277e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:09.693378 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c3201991-3b73-4a58-bcf0-c4928e04277e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:09.693806 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c3201991-3b73-4a58-bcf0-c4928e04277e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:09.773436 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b40cc2ec-57cf-47a9-962b-13a3cabba600 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:09.774039 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b40cc2ec-57cf-47a9-962b-13a3cabba600 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:09.781955 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b40cc2ec-57cf-47a9-962b-13a3cabba600 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:09.782402 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b40cc2ec-57cf-47a9-962b-13a3cabba600 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:09.783207 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b40cc2ec-57cf-47a9-962b-13a3cabba600 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:09.783640 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b40cc2ec-57cf-47a9-962b-13a3cabba600 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:09.866208 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c3201991-3b73-4a58-bcf0-c4928e04277e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:09.875524 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c3201991-3b73-4a58-bcf0-c4928e04277e tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.193019 Nov 24 15:27:09.876269 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 401/858] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:09 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:27:09.937090 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b40cc2ec-57cf-47a9-962b-13a3cabba600 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:09.944796 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b40cc2ec-57cf-47a9-962b-13a3cabba600 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:09.946285 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b40cc2ec-57cf-47a9-962b-13a3cabba600 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:09.947512 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b40cc2ec-57cf-47a9-962b-13a3cabba600 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1662 microversion: 2.20 time: 0.177780 Nov 24 15:27:09.948138 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 458/859] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:09 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1662 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:27:09.965545 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a78d0a04-e593-4f29-a838-068a95a5a77d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40e25815-10c3-485d-a204-cffa348567d6"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:27:09.966641 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a78d0a04-e593-4f29-a838-068a95a5a77d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:09.972554 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a78d0a04-e593-4f29-a838-068a95a5a77d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:09.972996 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a78d0a04-e593-4f29-a838-068a95a5a77d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:09.973769 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a78d0a04-e593-4f29-a838-068a95a5a77d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:09.974205 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a78d0a04-e593-4f29-a838-068a95a5a77d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:10.219405 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a78d0a04-e593-4f29-a838-068a95a5a77d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.257533 Nov 24 15:27:10.220015 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 402/860] 10.222.0.66 () {62 vars in 1363 bytes} [Wed Nov 24 15:27:09 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/os-volume_attachments => generated 188 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 24 15:27:10.327445 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ae19f5eb-efff-4263-ae12-fd5ecb7d585d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:10.327965 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ae19f5eb-efff-4263-ae12-fd5ecb7d585d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:10.333712 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae19f5eb-efff-4263-ae12-fd5ecb7d585d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:10.334157 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae19f5eb-efff-4263-ae12-fd5ecb7d585d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:10.335545 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae19f5eb-efff-4263-ae12-fd5ecb7d585d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:10.335977 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ae19f5eb-efff-4263-ae12-fd5ecb7d585d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:10.557382 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ae19f5eb-efff-4263-ae12-fd5ecb7d585d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/os-volume_attachments/40e25815-10c3-485d-a204-cffa348567d6" status: 202 len: 0 microversion: 2.20 time: 0.233516 Nov 24 15:27:10.557929 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 459/861] 10.222.0.66 () {60 vars in 1456 bytes} [Wed Nov 24 15:27:10 2021] DELETE /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/os-volume_attachments/40e25815-10c3-485d-a204-cffa348567d6 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:27:10.611245 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-33a77daa-b6b7-43f4-a413-c2bcdf81324d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:27:10.611803 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-33a77daa-b6b7-43f4-a413-c2bcdf81324d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:10.617930 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-33a77daa-b6b7-43f4-a413-c2bcdf81324d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:10.618373 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-33a77daa-b6b7-43f4-a413-c2bcdf81324d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:10.619173 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-33a77daa-b6b7-43f4-a413-c2bcdf81324d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:10.619603 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-33a77daa-b6b7-43f4-a413-c2bcdf81324d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:10.709972 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-33a77daa-b6b7-43f4-a413-c2bcdf81324d tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action" status: 202 len: 0 microversion: 2.20 time: 0.102933 Nov 24 15:27:10.710651 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 403/862] 10.222.0.66 () {62 vars in 1318 bytes} [Wed Nov 24 15:27:10 2021] POST /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:27:10.718511 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-cb30167a-e453-4782-bbd3-03060b4c803a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:10.719340 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-cb30167a-e453-4782-bbd3-03060b4c803a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:10.725664 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb30167a-e453-4782-bbd3-03060b4c803a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:10.726118 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb30167a-e453-4782-bbd3-03060b4c803a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:10.726934 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb30167a-e453-4782-bbd3-03060b4c803a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:10.727370 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-cb30167a-e453-4782-bbd3-03060b4c803a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:10.869999 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cb30167a-e453-4782-bbd3-03060b4c803a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:10.877842 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cb30167a-e453-4782-bbd3-03060b4c803a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:10.879351 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-cb30167a-e453-4782-bbd3-03060b4c803a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:10.880494 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-cb30167a-e453-4782-bbd3-03060b4c803a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1670 microversion: 2.20 time: 0.165766 Nov 24 15:27:10.881052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 460/863] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:10 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:10.892158 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-430dc6e6-f052-417d-82a9-a81e3cdeefb0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:10.892907 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-430dc6e6-f052-417d-82a9-a81e3cdeefb0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:10.899084 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-430dc6e6-f052-417d-82a9-a81e3cdeefb0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:10.899599 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-430dc6e6-f052-417d-82a9-a81e3cdeefb0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:10.900464 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-430dc6e6-f052-417d-82a9-a81e3cdeefb0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:10.900968 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-430dc6e6-f052-417d-82a9-a81e3cdeefb0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:11.036514 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-430dc6e6-f052-417d-82a9-a81e3cdeefb0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:11.044935 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-430dc6e6-f052-417d-82a9-a81e3cdeefb0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.156445 Nov 24 15:27:11.045519 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 404/864] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:10 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:27:11.891263 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-a9b64c09-1717-43ab-9ff0-60798e810862 req-1d718e96-ce34-45d8-a7fb-0d488806afe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68310acb-6f2f-4a32-9b65-20ae91f67062", "name": "network-vif-unplugged", "status": "completed", "tag": "071fb078-3f83-4604-a050-d36e5c042f5f"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:27:11.892995 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:27:11.892995 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:27:11.901591 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-a9b64c09-1717-43ab-9ff0-60798e810862 req-1d718e96-ce34-45d8-a7fb-0d488806afe8 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:11.902621 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-a9b64c09-1717-43ab-9ff0-60798e810862 req-1d718e96-ce34-45d8-a7fb-0d488806afe8 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:11.903177 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3d578305-08fb-4712-b06b-15a92fd148f3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:11.904396 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3d578305-08fb-4712-b06b-15a92fd148f3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:11.911761 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3d578305-08fb-4712-b06b-15a92fd148f3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:11.912328 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3d578305-08fb-4712-b06b-15a92fd148f3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:11.913615 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3d578305-08fb-4712-b06b-15a92fd148f3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:11.914067 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3d578305-08fb-4712-b06b-15a92fd148f3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:11.919466 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-a9b64c09-1717-43ab-9ff0-60798e810862 req-1d718e96-ce34-45d8-a7fb-0d488806afe8 service nova] Creating event network-vif-unplugged:071fb078-3f83-4604-a050-d36e5c042f5f for instance 68310acb-6f2f-4a32-9b65-20ae91f67062 on hv-cinder-80403 Nov 24 15:27:11.924805 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-a9b64c09-1717-43ab-9ff0-60798e810862 req-1d718e96-ce34-45d8-a7fb-0d488806afe8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037123 Nov 24 15:27:11.925953 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 461/865] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:27:11 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:27:12.061767 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-de23de82-cfe6-4f1e-9895-79ab114e36bf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:12.062522 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-de23de82-cfe6-4f1e-9895-79ab114e36bf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:12.067975 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-3d578305-08fb-4712-b06b-15a92fd148f3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:12.074478 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-de23de82-cfe6-4f1e-9895-79ab114e36bf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:12.075076 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-de23de82-cfe6-4f1e-9895-79ab114e36bf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:12.076054 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-de23de82-cfe6-4f1e-9895-79ab114e36bf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:12.076682 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-de23de82-cfe6-4f1e-9895-79ab114e36bf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:12.077631 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-3d578305-08fb-4712-b06b-15a92fd148f3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:12.079266 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-3d578305-08fb-4712-b06b-15a92fd148f3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:12.080554 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3d578305-08fb-4712-b06b-15a92fd148f3 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1728 microversion: 2.20 time: 0.183886 Nov 24 15:27:12.081332 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 405/866] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:11 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:12.215587 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-de23de82-cfe6-4f1e-9895-79ab114e36bf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:12.223794 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-de23de82-cfe6-4f1e-9895-79ab114e36bf tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.165964 Nov 24 15:27:12.230932 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 462/867] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:12 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:27:13.098029 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-df5f69f0-bbbc-4c56-ba6d-68a11d37d107 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:13.099298 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-df5f69f0-bbbc-4c56-ba6d-68a11d37d107 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:13.106031 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-df5f69f0-bbbc-4c56-ba6d-68a11d37d107 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:13.106478 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-df5f69f0-bbbc-4c56-ba6d-68a11d37d107 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:13.107310 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-df5f69f0-bbbc-4c56-ba6d-68a11d37d107 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:13.107770 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-df5f69f0-bbbc-4c56-ba6d-68a11d37d107 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:13.240734 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8a648436-9602-4d31-a954-3790b67e7e68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:13.249670 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-df5f69f0-bbbc-4c56-ba6d-68a11d37d107 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:13.249873 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8a648436-9602-4d31-a954-3790b67e7e68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:13.256578 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a648436-9602-4d31-a954-3790b67e7e68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:13.257864 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-df5f69f0-bbbc-4c56-ba6d-68a11d37d107 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:13.259620 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-df5f69f0-bbbc-4c56-ba6d-68a11d37d107 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:13.260835 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-df5f69f0-bbbc-4c56-ba6d-68a11d37d107 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1728 microversion: 2.20 time: 0.166459 Nov 24 15:27:13.261395 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 406/868] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:13 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:13.267785 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a648436-9602-4d31-a954-3790b67e7e68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:13.267785 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a648436-9602-4d31-a954-3790b67e7e68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:13.267785 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8a648436-9602-4d31-a954-3790b67e7e68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:13.407874 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8a648436-9602-4d31-a954-3790b67e7e68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:13.415821 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8a648436-9602-4d31-a954-3790b67e7e68 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.179238 Nov 24 15:27:13.416617 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 463/869] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:13 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:27:14.041454 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-89dd6904-7587-4007-b29b-db9559cee603 req-98abdd4c-fc13-4812-90c0-0e9bfcc8c7f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89769a5-ef2a-400a-9c59-3053f647e3c2", "name": "network-vif-plugged", "status": "completed", "tag": "2acc53e6-5fad-45de-9695-638ed83c9206"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:27:14.043188 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:27:14.043188 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:27:14.050258 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-89dd6904-7587-4007-b29b-db9559cee603 req-98abdd4c-fc13-4812-90c0-0e9bfcc8c7f0 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:14.050850 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-89dd6904-7587-4007-b29b-db9559cee603 req-98abdd4c-fc13-4812-90c0-0e9bfcc8c7f0 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:14.062489 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-89dd6904-7587-4007-b29b-db9559cee603 req-98abdd4c-fc13-4812-90c0-0e9bfcc8c7f0 service nova] Creating event network-vif-plugged:2acc53e6-5fad-45de-9695-638ed83c9206 for instance b89769a5-ef2a-400a-9c59-3053f647e3c2 on hv-cinder-80403 Nov 24 15:27:14.067857 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-89dd6904-7587-4007-b29b-db9559cee603 req-98abdd4c-fc13-4812-90c0-0e9bfcc8c7f0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030968 Nov 24 15:27:14.069039 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 407/870] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:27:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:27:14.278852 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7877ec5c-b895-411d-a1aa-2f37e0552fe8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:14.279473 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7877ec5c-b895-411d-a1aa-2f37e0552fe8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:14.285781 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7877ec5c-b895-411d-a1aa-2f37e0552fe8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:14.286234 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7877ec5c-b895-411d-a1aa-2f37e0552fe8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:14.287049 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7877ec5c-b895-411d-a1aa-2f37e0552fe8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:14.287491 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7877ec5c-b895-411d-a1aa-2f37e0552fe8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:14.425495 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7877ec5c-b895-411d-a1aa-2f37e0552fe8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:14.433364 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ae982f2a-0b98-4516-a779-c769b0f9ea2f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:14.433916 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7877ec5c-b895-411d-a1aa-2f37e0552fe8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:14.434057 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ae982f2a-0b98-4516-a779-c769b0f9ea2f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:14.435366 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7877ec5c-b895-411d-a1aa-2f37e0552fe8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:14.436528 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7877ec5c-b895-411d-a1aa-2f37e0552fe8 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1728 microversion: 2.20 time: 0.161423 Nov 24 15:27:14.437089 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 464/871] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:14 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:14.451862 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ae982f2a-0b98-4516-a779-c769b0f9ea2f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:14.452304 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ae982f2a-0b98-4516-a779-c769b0f9ea2f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:14.453085 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ae982f2a-0b98-4516-a779-c769b0f9ea2f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:14.453517 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ae982f2a-0b98-4516-a779-c769b0f9ea2f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:14.592378 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ae982f2a-0b98-4516-a779-c769b0f9ea2f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:14.599969 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ae982f2a-0b98-4516-a779-c769b0f9ea2f tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.170926 Nov 24 15:27:14.600765 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 408/872] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:14 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:27:15.455014 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9659cc7e-8afd-4dd4-83fb-a33288b280f4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:15.455605 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9659cc7e-8afd-4dd4-83fb-a33288b280f4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:15.461941 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9659cc7e-8afd-4dd4-83fb-a33288b280f4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:15.462393 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9659cc7e-8afd-4dd4-83fb-a33288b280f4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:15.463203 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9659cc7e-8afd-4dd4-83fb-a33288b280f4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:15.463639 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9659cc7e-8afd-4dd4-83fb-a33288b280f4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:15.603792 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9659cc7e-8afd-4dd4-83fb-a33288b280f4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:15.613527 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9659cc7e-8afd-4dd4-83fb-a33288b280f4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:15.615289 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9659cc7e-8afd-4dd4-83fb-a33288b280f4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:15.617064 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b862fcc8-9d0b-48be-850e-7433d3caf270 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:15.618464 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b862fcc8-9d0b-48be-850e-7433d3caf270 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:15.622799 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9659cc7e-8afd-4dd4-83fb-a33288b280f4 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1728 microversion: 2.20 time: 0.171510 Nov 24 15:27:15.623687 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 465/873] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:15 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:15.625248 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b862fcc8-9d0b-48be-850e-7433d3caf270 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:15.625776 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b862fcc8-9d0b-48be-850e-7433d3caf270 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:15.626679 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b862fcc8-9d0b-48be-850e-7433d3caf270 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:15.627276 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b862fcc8-9d0b-48be-850e-7433d3caf270 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:15.764307 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-b862fcc8-9d0b-48be-850e-7433d3caf270 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:15.771940 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b862fcc8-9d0b-48be-850e-7433d3caf270 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.159091 Nov 24 15:27:15.772496 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 409/874] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:15 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:27:16.640867 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-291d4f71-fe2e-4c43-ac8a-d4a6eb95e287 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:16.641754 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-291d4f71-fe2e-4c43-ac8a-d4a6eb95e287 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:16.647933 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-291d4f71-fe2e-4c43-ac8a-d4a6eb95e287 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:16.648384 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-291d4f71-fe2e-4c43-ac8a-d4a6eb95e287 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:16.649170 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-291d4f71-fe2e-4c43-ac8a-d4a6eb95e287 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:16.649606 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-291d4f71-fe2e-4c43-ac8a-d4a6eb95e287 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:16.788794 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8b3797a7-12ce-48c1-b863-39d4c7741927 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:16.790072 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8b3797a7-12ce-48c1-b863-39d4c7741927 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:16.795363 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-291d4f71-fe2e-4c43-ac8a-d4a6eb95e287 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:16.800983 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8b3797a7-12ce-48c1-b863-39d4c7741927 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:16.801428 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8b3797a7-12ce-48c1-b863-39d4c7741927 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:16.802431 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8b3797a7-12ce-48c1-b863-39d4c7741927 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:16.802880 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8b3797a7-12ce-48c1-b863-39d4c7741927 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:16.803569 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-291d4f71-fe2e-4c43-ac8a-d4a6eb95e287 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:16.805738 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-291d4f71-fe2e-4c43-ac8a-d4a6eb95e287 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:16.806947 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-291d4f71-fe2e-4c43-ac8a-d4a6eb95e287 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1728 microversion: 2.20 time: 0.169802 Nov 24 15:27:16.807528 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 466/875] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:16 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:16.942644 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8b3797a7-12ce-48c1-b863-39d4c7741927 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:16.950537 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8b3797a7-12ce-48c1-b863-39d4c7741927 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.165706 Nov 24 15:27:16.951177 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 410/876] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:16 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:27:17.825981 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1721438e-bf94-4a05-aab5-399b4d90632b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:17.826572 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1721438e-bf94-4a05-aab5-399b4d90632b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:17.832956 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1721438e-bf94-4a05-aab5-399b4d90632b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:17.833408 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1721438e-bf94-4a05-aab5-399b4d90632b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:17.834181 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1721438e-bf94-4a05-aab5-399b4d90632b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:17.834618 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1721438e-bf94-4a05-aab5-399b4d90632b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:17.968028 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-1b6b180a-7734-40c6-a4a5-6360e90687dc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:17.968647 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-1b6b180a-7734-40c6-a4a5-6360e90687dc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:17.974354 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1721438e-bf94-4a05-aab5-399b4d90632b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:17.975955 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1b6b180a-7734-40c6-a4a5-6360e90687dc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:17.976412 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1b6b180a-7734-40c6-a4a5-6360e90687dc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:17.977387 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1b6b180a-7734-40c6-a4a5-6360e90687dc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:17.977825 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-1b6b180a-7734-40c6-a4a5-6360e90687dc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:17.986411 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1721438e-bf94-4a05-aab5-399b4d90632b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:17.988548 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-1721438e-bf94-4a05-aab5-399b4d90632b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:17.989703 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1721438e-bf94-4a05-aab5-399b4d90632b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1728 microversion: 2.20 time: 0.167395 Nov 24 15:27:18.001713 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 467/877] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:17 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:18.115025 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-1b6b180a-7734-40c6-a4a5-6360e90687dc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:18.123080 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-1b6b180a-7734-40c6-a4a5-6360e90687dc tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.158835 Nov 24 15:27:18.123657 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 411/878] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:17 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:27:19.008711 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-370689d4-3fb4-4508-8931-58da16765792 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:19.009309 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-370689d4-3fb4-4508-8931-58da16765792 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:19.016409 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-370689d4-3fb4-4508-8931-58da16765792 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:19.016855 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-370689d4-3fb4-4508-8931-58da16765792 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:19.017644 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-370689d4-3fb4-4508-8931-58da16765792 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:19.018102 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-370689d4-3fb4-4508-8931-58da16765792 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:19.140133 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-0baebdf9-613d-4436-a7b3-5da95fee0c4d tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:19.141010 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-0baebdf9-613d-4436-a7b3-5da95fee0c4d tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:19.149406 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0baebdf9-613d-4436-a7b3-5da95fee0c4d tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:19.150217 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0baebdf9-613d-4436-a7b3-5da95fee0c4d tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:19.151319 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0baebdf9-613d-4436-a7b3-5da95fee0c4d tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:19.151853 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0baebdf9-613d-4436-a7b3-5da95fee0c4d tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:19.157857 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-370689d4-3fb4-4508-8931-58da16765792 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:19.166571 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-370689d4-3fb4-4508-8931-58da16765792 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:19.168149 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-370689d4-3fb4-4508-8931-58da16765792 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:19.169405 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-370689d4-3fb4-4508-8931-58da16765792 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1728 microversion: 2.20 time: 0.164486 Nov 24 15:27:19.170184 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 468/879] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:19 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:19.303375 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-0baebdf9-613d-4436-a7b3-5da95fee0c4d tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:19.311562 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-0baebdf9-613d-4436-a7b3-5da95fee0c4d tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.174973 Nov 24 15:27:19.312161 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 412/880] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:19 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:27:20.187814 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-55622784-eb5a-4260-bdd9-7c960bd8afde tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:20.188440 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-55622784-eb5a-4260-bdd9-7c960bd8afde tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:20.194670 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55622784-eb5a-4260-bdd9-7c960bd8afde tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:20.195151 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55622784-eb5a-4260-bdd9-7c960bd8afde tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:20.195928 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55622784-eb5a-4260-bdd9-7c960bd8afde tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:20.196360 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-55622784-eb5a-4260-bdd9-7c960bd8afde tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:20.328678 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-eaf14b60-5439-4835-abf3-818266cc58cb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:20.329446 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-eaf14b60-5439-4835-abf3-818266cc58cb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:20.332899 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-55622784-eb5a-4260-bdd9-7c960bd8afde tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:20.336668 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eaf14b60-5439-4835-abf3-818266cc58cb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:20.337109 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eaf14b60-5439-4835-abf3-818266cc58cb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:20.337890 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eaf14b60-5439-4835-abf3-818266cc58cb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:20.338317 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-eaf14b60-5439-4835-abf3-818266cc58cb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:20.341416 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-55622784-eb5a-4260-bdd9-7c960bd8afde tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:20.342935 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-55622784-eb5a-4260-bdd9-7c960bd8afde tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:20.344097 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-55622784-eb5a-4260-bdd9-7c960bd8afde tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1728 microversion: 2.20 time: 0.160062 Nov 24 15:27:20.355216 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 469/881] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:20 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:20.482337 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-eaf14b60-5439-4835-abf3-818266cc58cb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:20.490874 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-eaf14b60-5439-4835-abf3-818266cc58cb tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.166292 Nov 24 15:27:20.491488 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 413/882] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:20 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:27:21.363055 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-53a2c1bb-183c-4e8c-a7b1-5173ed86cc87 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:21.363946 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-53a2c1bb-183c-4e8c-a7b1-5173ed86cc87 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:21.370977 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53a2c1bb-183c-4e8c-a7b1-5173ed86cc87 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:21.371424 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53a2c1bb-183c-4e8c-a7b1-5173ed86cc87 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:21.372212 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53a2c1bb-183c-4e8c-a7b1-5173ed86cc87 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:21.372623 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-53a2c1bb-183c-4e8c-a7b1-5173ed86cc87 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:21.507232 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-81296880-4532-49e0-b5ee-40d06c9c0e98 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:21.507814 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-81296880-4532-49e0-b5ee-40d06c9c0e98 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:21.513815 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-53a2c1bb-183c-4e8c-a7b1-5173ed86cc87 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:21.514278 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-81296880-4532-49e0-b5ee-40d06c9c0e98 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:21.514674 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-81296880-4532-49e0-b5ee-40d06c9c0e98 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:21.515480 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-81296880-4532-49e0-b5ee-40d06c9c0e98 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:21.515909 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-81296880-4532-49e0-b5ee-40d06c9c0e98 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:21.525941 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-53a2c1bb-183c-4e8c-a7b1-5173ed86cc87 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:21.527484 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-53a2c1bb-183c-4e8c-a7b1-5173ed86cc87 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:21.528646 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-53a2c1bb-183c-4e8c-a7b1-5173ed86cc87 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1728 microversion: 2.20 time: 0.169404 Nov 24 15:27:21.529443 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 470/883] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:21 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:21.651194 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-81296880-4532-49e0-b5ee-40d06c9c0e98 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:21.658625 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-81296880-4532-49e0-b5ee-40d06c9c0e98 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.155029 Nov 24 15:27:21.659235 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 414/884] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:21 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:27:22.547534 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c16ad911-c4e4-42ca-ab1b-4c5d5d18d23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:22.548126 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c16ad911-c4e4-42ca-ab1b-4c5d5d18d23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:22.554567 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c16ad911-c4e4-42ca-ab1b-4c5d5d18d23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:22.554843 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c16ad911-c4e4-42ca-ab1b-4c5d5d18d23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:22.555851 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c16ad911-c4e4-42ca-ab1b-4c5d5d18d23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:22.556294 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c16ad911-c4e4-42ca-ab1b-4c5d5d18d23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:22.675642 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-5c100b50-a4de-49e0-9e21-ce03fb755742 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:22.676299 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-5c100b50-a4de-49e0-9e21-ce03fb755742 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:22.682394 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c100b50-a4de-49e0-9e21-ce03fb755742 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:22.682873 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c100b50-a4de-49e0-9e21-ce03fb755742 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:22.683651 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c100b50-a4de-49e0-9e21-ce03fb755742 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:22.684084 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c100b50-a4de-49e0-9e21-ce03fb755742 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:22.702703 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c16ad911-c4e4-42ca-ab1b-4c5d5d18d23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:22.712518 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c16ad911-c4e4-42ca-ab1b-4c5d5d18d23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:22.713997 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c16ad911-c4e4-42ca-ab1b-4c5d5d18d23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:22.715214 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c16ad911-c4e4-42ca-ab1b-4c5d5d18d23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1728 microversion: 2.20 time: 0.171445 Nov 24 15:27:22.715792 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 471/885] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:22 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:22.818966 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-5c100b50-a4de-49e0-9e21-ce03fb755742 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:22.826789 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-5c100b50-a4de-49e0-9e21-ce03fb755742 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.154795 Nov 24 15:27:22.827383 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 415/886] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:22 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:27:23.733381 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-089d1857-f386-447c-aaa0-30156447d271 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:23.733948 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-089d1857-f386-447c-aaa0-30156447d271 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:23.740458 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-089d1857-f386-447c-aaa0-30156447d271 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:23.740896 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-089d1857-f386-447c-aaa0-30156447d271 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:23.742387 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-089d1857-f386-447c-aaa0-30156447d271 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:23.742835 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-089d1857-f386-447c-aaa0-30156447d271 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:23.843919 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6c689e23-d710-40da-9954-b004b2c1396a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:23.844529 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6c689e23-d710-40da-9954-b004b2c1396a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:23.851792 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6c689e23-d710-40da-9954-b004b2c1396a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:23.852242 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6c689e23-d710-40da-9954-b004b2c1396a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:23.853021 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6c689e23-d710-40da-9954-b004b2c1396a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:23.853453 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6c689e23-d710-40da-9954-b004b2c1396a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:23.873770 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-089d1857-f386-447c-aaa0-30156447d271 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:23.881705 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-089d1857-f386-447c-aaa0-30156447d271 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:23.883241 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-089d1857-f386-447c-aaa0-30156447d271 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:23.885067 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-089d1857-f386-447c-aaa0-30156447d271 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1728 microversion: 2.20 time: 0.155474 Nov 24 15:27:23.885638 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 472/887] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:23 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:23.983943 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6c689e23-d710-40da-9954-b004b2c1396a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:23.991390 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6c689e23-d710-40da-9954-b004b2c1396a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.151126 Nov 24 15:27:23.992074 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 416/888] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:23 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:27:24.902890 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9ed1b574-6693-40c2-8037-a4f6d5fe2ecb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:24.903475 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9ed1b574-6693-40c2-8037-a4f6d5fe2ecb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:24.909753 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ed1b574-6693-40c2-8037-a4f6d5fe2ecb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:24.910195 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ed1b574-6693-40c2-8037-a4f6d5fe2ecb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:24.910995 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ed1b574-6693-40c2-8037-a4f6d5fe2ecb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:24.911424 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9ed1b574-6693-40c2-8037-a4f6d5fe2ecb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:25.009318 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4d64e30e-3bd6-44f6-bd03-b2db6463178b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:25.009932 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4d64e30e-3bd6-44f6-bd03-b2db6463178b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:25.016230 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4d64e30e-3bd6-44f6-bd03-b2db6463178b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:25.016686 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4d64e30e-3bd6-44f6-bd03-b2db6463178b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:25.017469 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4d64e30e-3bd6-44f6-bd03-b2db6463178b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:25.017904 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4d64e30e-3bd6-44f6-bd03-b2db6463178b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:25.068483 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9ed1b574-6693-40c2-8037-a4f6d5fe2ecb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:25.077489 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9ed1b574-6693-40c2-8037-a4f6d5fe2ecb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:25.079393 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9ed1b574-6693-40c2-8037-a4f6d5fe2ecb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:25.080780 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9ed1b574-6693-40c2-8037-a4f6d5fe2ecb tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1728 microversion: 2.20 time: 0.181462 Nov 24 15:27:25.081387 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 473/889] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:24 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:25.159266 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4d64e30e-3bd6-44f6-bd03-b2db6463178b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:25.167266 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4d64e30e-3bd6-44f6-bd03-b2db6463178b tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.161615 Nov 24 15:27:25.167950 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 417/890] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:25 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:27:26.098588 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-94224a86-4d6e-412b-869f-45a9301a1b31 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:26.099217 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-94224a86-4d6e-412b-869f-45a9301a1b31 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:26.105359 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94224a86-4d6e-412b-869f-45a9301a1b31 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:26.105804 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94224a86-4d6e-412b-869f-45a9301a1b31 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:26.106575 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94224a86-4d6e-412b-869f-45a9301a1b31 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:26.107027 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-94224a86-4d6e-412b-869f-45a9301a1b31 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:26.184534 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2199821e-b94d-49b2-b116-929ef94a53e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:26.185275 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2199821e-b94d-49b2-b116-929ef94a53e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:26.191707 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2199821e-b94d-49b2-b116-929ef94a53e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:26.192159 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2199821e-b94d-49b2-b116-929ef94a53e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:26.192976 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2199821e-b94d-49b2-b116-929ef94a53e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:26.193416 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2199821e-b94d-49b2-b116-929ef94a53e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:26.246957 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-94224a86-4d6e-412b-869f-45a9301a1b31 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:26.254985 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-94224a86-4d6e-412b-869f-45a9301a1b31 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:26.256668 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-94224a86-4d6e-412b-869f-45a9301a1b31 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:26.258467 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-94224a86-4d6e-412b-869f-45a9301a1b31 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1728 microversion: 2.20 time: 0.163080 Nov 24 15:27:26.259390 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 474/891] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:26 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:27:26.336072 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-2199821e-b94d-49b2-b116-929ef94a53e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:26.343388 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2199821e-b94d-49b2-b116-929ef94a53e6 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1267 microversion: 2.1 time: 0.162564 Nov 24 15:27:26.343961 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 418/892] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:26 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:27:27.276854 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-719bbc26-2a2d-47be-9480-0e6bce7bd476 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:27.277462 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-719bbc26-2a2d-47be-9480-0e6bce7bd476 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:27.283946 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-719bbc26-2a2d-47be-9480-0e6bce7bd476 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:27.284422 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-719bbc26-2a2d-47be-9480-0e6bce7bd476 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:27.285206 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-719bbc26-2a2d-47be-9480-0e6bce7bd476 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:27.285638 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-719bbc26-2a2d-47be-9480-0e6bce7bd476 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:27.360238 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-d24ee820-82e5-40bc-8d13-c71b46d35bc2 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:27.360927 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-d24ee820-82e5-40bc-8d13-c71b46d35bc2 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:27.368727 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d24ee820-82e5-40bc-8d13-c71b46d35bc2 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:27.368901 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d24ee820-82e5-40bc-8d13-c71b46d35bc2 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:27.369681 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d24ee820-82e5-40bc-8d13-c71b46d35bc2 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:27.370112 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d24ee820-82e5-40bc-8d13-c71b46d35bc2 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:27.453102 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-719bbc26-2a2d-47be-9480-0e6bce7bd476 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:27.461420 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-719bbc26-2a2d-47be-9480-0e6bce7bd476 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:27.462956 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-719bbc26-2a2d-47be-9480-0e6bce7bd476 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:27.464162 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-719bbc26-2a2d-47be-9480-0e6bce7bd476 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1728 microversion: 2.20 time: 0.190965 Nov 24 15:27:27.464861 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 475/893] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:27 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:27.531187 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-d24ee820-82e5-40bc-8d13-c71b46d35bc2 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:27.539376 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-d24ee820-82e5-40bc-8d13-c71b46d35bc2 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1454 microversion: 2.1 time: 0.182333 Nov 24 15:27:27.539947 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 419/894] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:27 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1454 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:27:27.555496 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f79d13e0-a3f1-425a-8e3c-b946a44c96e9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:27.556107 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f79d13e0-a3f1-425a-8e3c-b946a44c96e9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:27.561870 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f79d13e0-a3f1-425a-8e3c-b946a44c96e9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:27.562318 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f79d13e0-a3f1-425a-8e3c-b946a44c96e9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:27.563122 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f79d13e0-a3f1-425a-8e3c-b946a44c96e9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:27.563562 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f79d13e0-a3f1-425a-8e3c-b946a44c96e9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:27.697623 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f79d13e0-a3f1-425a-8e3c-b946a44c96e9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:27.705905 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f79d13e0-a3f1-425a-8e3c-b946a44c96e9 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1454 microversion: 2.1 time: 0.153979 Nov 24 15:27:27.706482 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 476/895] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:27:27 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:27:28.481425 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-50ff819c-5a1c-4782-b568-ee3c4c40c23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:27:28.482047 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-50ff819c-5a1c-4782-b568-ee3c4c40c23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:27:28.488796 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-50ff819c-5a1c-4782-b568-ee3c4c40c23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:28.489245 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-50ff819c-5a1c-4782-b568-ee3c4c40c23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:28.490036 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-50ff819c-5a1c-4782-b568-ee3c4c40c23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:28.490468 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-50ff819c-5a1c-4782-b568-ee3c4c40c23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:28.622482 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-50ff819c-5a1c-4782-b568-ee3c4c40c23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:28.631409 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-50ff819c-5a1c-4782-b568-ee3c4c40c23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:28.633543 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-50ff819c-5a1c-4782-b568-ee3c4c40c23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:27:28.634881 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-50ff819c-5a1c-4782-b568-ee3c4c40c23c tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1715 microversion: 2.20 time: 0.157251 Nov 24 15:27:28.635481 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 420/896] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:27:28 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1715 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:27:29.687260 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-a6d3aa82-2ffa-4d00-9898-75b443cc563c req-47cb621e-17ff-42a1-a4f4-428a1ca6f847 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b89769a5-ef2a-400a-9c59-3053f647e3c2", "tag": "2acc53e6-5fad-45de-9695-638ed83c9206"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:27:29.687260 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:27:29.687260 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:27:29.695064 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-a6d3aa82-2ffa-4d00-9898-75b443cc563c req-47cb621e-17ff-42a1-a4f4-428a1ca6f847 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:29.695505 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-a6d3aa82-2ffa-4d00-9898-75b443cc563c req-47cb621e-17ff-42a1-a4f4-428a1ca6f847 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:29.706921 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-a6d3aa82-2ffa-4d00-9898-75b443cc563c req-47cb621e-17ff-42a1-a4f4-428a1ca6f847 service nova] Creating event network-changed:2acc53e6-5fad-45de-9695-638ed83c9206 for instance b89769a5-ef2a-400a-9c59-3053f647e3c2 on hv-cinder-80403 Nov 24 15:27:29.712591 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-a6d3aa82-2ffa-4d00-9898-75b443cc563c req-47cb621e-17ff-42a1-a4f4-428a1ca6f847 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030415 Nov 24 15:27:29.713445 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 477/897] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:27:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:27:29.874789 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-dab36473-c2ca-42a8-a441-c23b1bca8599 req-9546a827-a953-475f-9e14-9cd08681ac4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68310acb-6f2f-4a32-9b65-20ae91f67062", "name": "network-vif-plugged", "status": "completed", "tag": "071fb078-3f83-4604-a050-d36e5c042f5f"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:27:29.878222 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:27:29.878222 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:27:29.891048 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-dab36473-c2ca-42a8-a441-c23b1bca8599 req-9546a827-a953-475f-9e14-9cd08681ac4e service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:27:29.891982 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-dab36473-c2ca-42a8-a441-c23b1bca8599 req-9546a827-a953-475f-9e14-9cd08681ac4e service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:27:29.905951 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-dab36473-c2ca-42a8-a441-c23b1bca8599 req-9546a827-a953-475f-9e14-9cd08681ac4e service nova] Creating event network-vif-plugged:071fb078-3f83-4604-a050-d36e5c042f5f for instance 68310acb-6f2f-4a32-9b65-20ae91f67062 on hv-cinder-80403 Nov 24 15:27:29.912635 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-dab36473-c2ca-42a8-a441-c23b1bca8599 req-9546a827-a953-475f-9e14-9cd08681ac4e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042002 Nov 24 15:27:29.913869 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 421/898] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:27:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:28:01.390518 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ee55aeb0-7ee8-4a85-973f-af9380650599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:01.391556 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ee55aeb0-7ee8-4a85-973f-af9380650599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:01.397752 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ee55aeb0-7ee8-4a85-973f-af9380650599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:01.398199 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ee55aeb0-7ee8-4a85-973f-af9380650599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:01.399025 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ee55aeb0-7ee8-4a85-973f-af9380650599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:01.399466 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ee55aeb0-7ee8-4a85-973f-af9380650599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:01.429729 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ee55aeb0-7ee8-4a85-973f-af9380650599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044188 Nov 24 15:28:01.430306 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 478/899] 10.222.0.66 () {60 vars in 1342 bytes} [Wed Nov 24 15:28:01 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:01.486525 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-dd0f3e10-e15e-4ac3-9cc0-7d25e3b9a80a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:01.487144 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-dd0f3e10-e15e-4ac3-9cc0-7d25e3b9a80a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:01.493580 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dd0f3e10-e15e-4ac3-9cc0-7d25e3b9a80a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:01.494033 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dd0f3e10-e15e-4ac3-9cc0-7d25e3b9a80a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:01.494832 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dd0f3e10-e15e-4ac3-9cc0-7d25e3b9a80a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:01.495429 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dd0f3e10-e15e-4ac3-9cc0-7d25e3b9a80a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:01.521132 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-dd0f3e10-e15e-4ac3-9cc0-7d25e3b9a80a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Going to try to terminate instance {{(pid=116073) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:28:01.599695 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-dd0f3e10-e15e-4ac3-9cc0-7d25e3b9a80a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 204 len: 0 microversion: 2.20 time: 0.116996 Nov 24 15:28:01.600445 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 422/900] 10.222.0.66 () {60 vars in 1279 bytes} [Wed Nov 24 15:28:01 2021] DELETE /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 15:28:01.609004 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b2b6ae88-2284-4ea8-b4e8-3e1e943f11aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:01.609604 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b2b6ae88-2284-4ea8-b4e8-3e1e943f11aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:01.615731 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b2b6ae88-2284-4ea8-b4e8-3e1e943f11aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:01.616180 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b2b6ae88-2284-4ea8-b4e8-3e1e943f11aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:01.616947 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b2b6ae88-2284-4ea8-b4e8-3e1e943f11aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:01.617381 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b2b6ae88-2284-4ea8-b4e8-3e1e943f11aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:01.753651 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b2b6ae88-2284-4ea8-b4e8-3e1e943f11aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:01.761558 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b2b6ae88-2284-4ea8-b4e8-3e1e943f11aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:01.763095 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b2b6ae88-2284-4ea8-b4e8-3e1e943f11aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:01.764256 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b2b6ae88-2284-4ea8-b4e8-3e1e943f11aa tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1721 microversion: 2.20 time: 0.159559 Nov 24 15:28:01.764832 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 479/901] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:28:01 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 24 15:28:02.783904 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2da7c81d-80d4-4096-a367-bf68f9d2f599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:02.784589 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2da7c81d-80d4-4096-a367-bf68f9d2f599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:02.790871 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2da7c81d-80d4-4096-a367-bf68f9d2f599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:02.791319 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2da7c81d-80d4-4096-a367-bf68f9d2f599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:02.792082 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2da7c81d-80d4-4096-a367-bf68f9d2f599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:02.792507 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2da7c81d-80d4-4096-a367-bf68f9d2f599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:02.922711 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-2da7c81d-80d4-4096-a367-bf68f9d2f599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:02.930466 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-2da7c81d-80d4-4096-a367-bf68f9d2f599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:02.931994 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-2da7c81d-80d4-4096-a367-bf68f9d2f599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:02.933144 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2da7c81d-80d4-4096-a367-bf68f9d2f599 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1721 microversion: 2.20 time: 0.153370 Nov 24 15:28:02.934362 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 423/902] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:28:02 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:28:03.781933 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-1adc1238-c7b4-49fd-8984-0e6ae6f6fe68 req-07a2c070-3165-4300-a068-d14a36e5d451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68310acb-6f2f-4a32-9b65-20ae91f67062", "name": "network-vif-deleted", "tag": "071fb078-3f83-4604-a050-d36e5c042f5f"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:28:03.784414 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:28:03.784414 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:28:03.794633 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1adc1238-c7b4-49fd-8984-0e6ae6f6fe68 req-07a2c070-3165-4300-a068-d14a36e5d451 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:03.795095 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1adc1238-c7b4-49fd-8984-0e6ae6f6fe68 req-07a2c070-3165-4300-a068-d14a36e5d451 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:03.808683 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-1adc1238-c7b4-49fd-8984-0e6ae6f6fe68 req-07a2c070-3165-4300-a068-d14a36e5d451 service nova] Creating event network-vif-deleted:071fb078-3f83-4604-a050-d36e5c042f5f for instance 68310acb-6f2f-4a32-9b65-20ae91f67062 on hv-cinder-80403 Nov 24 15:28:03.813505 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-1adc1238-c7b4-49fd-8984-0e6ae6f6fe68 req-07a2c070-3165-4300-a068-d14a36e5d451 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036387 Nov 24 15:28:03.814171 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 480/903] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:28:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:28:03.951747 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b3987561-b6a7-4839-b2a0-ab0d9cc084d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:03.953339 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b3987561-b6a7-4839-b2a0-ab0d9cc084d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:03.962508 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b3987561-b6a7-4839-b2a0-ab0d9cc084d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:03.963382 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b3987561-b6a7-4839-b2a0-ab0d9cc084d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:03.964943 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b3987561-b6a7-4839-b2a0-ab0d9cc084d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:03.965567 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b3987561-b6a7-4839-b2a0-ab0d9cc084d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:04.003611 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b3987561-b6a7-4839-b2a0-ab0d9cc084d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:04.004199 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b3987561-b6a7-4839-b2a0-ab0d9cc084d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:04.004660 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-b3987561-b6a7-4839-b2a0-ab0d9cc084d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lazy-loading 'fault' on Instance uuid 68310acb-6f2f-4a32-9b65-20ae91f67062 {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:28:04.046279 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-b3987561-b6a7-4839-b2a0-ab0d9cc084d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:04.054140 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-b3987561-b6a7-4839-b2a0-ab0d9cc084d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:04.055680 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-b3987561-b6a7-4839-b2a0-ab0d9cc084d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b9a6a76c456447a0b1d07b757efaf601', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15cfbeac1f3f4700a4806775a9786f5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:04.056826 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b3987561-b6a7-4839-b2a0-ab0d9cc084d2 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 200 len: 1371 microversion: 2.20 time: 0.108834 Nov 24 15:28:04.057385 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 424/904] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:28:03 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 1371 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 24 15:28:05.075002 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b383f122-0212-4774-afec-32a7ca9bb356 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:05.075615 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b383f122-0212-4774-afec-32a7ca9bb356 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:05.082099 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b383f122-0212-4774-afec-32a7ca9bb356 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:05.082544 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b383f122-0212-4774-afec-32a7ca9bb356 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:05.083360 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b383f122-0212-4774-afec-32a7ca9bb356 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:05.083797 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b383f122-0212-4774-afec-32a7ca9bb356 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:05.096471 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-b383f122-0212-4774-afec-32a7ca9bb356 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] HTTP exception thrown: Instance 68310acb-6f2f-4a32-9b65-20ae91f67062 could not be found. Nov 24 15:28:05.097056 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b383f122-0212-4774-afec-32a7ca9bb356 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Returning 404 to user: Instance 68310acb-6f2f-4a32-9b65-20ae91f67062 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:28:05.097866 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b383f122-0212-4774-afec-32a7ca9bb356 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 404 len: 111 microversion: 2.20 time: 0.027025 Nov 24 15:28:05.098420 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 481/905] 10.222.0.66 () {60 vars in 1276 bytes} [Wed Nov 24 15:28:05 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 24 15:28:05.107062 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-0a12f79e-3cf7-4d3f-b12d-3bad9e92de9b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '.version_select at 0x7f930cbecc10>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:05.125833 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-0a12f79e-3cf7-4d3f-b12d-3bad9e92de9b tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-999669314" status: 204 len: 0 microversion: 2.20 time: 0.022746 Nov 24 15:28:05.126508 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 425/906] 10.222.0.66 () {60 vars in 1258 bytes} [Wed Nov 24 15:28:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-999669314 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 24 15:28:06.852730 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d7ab7016-c547-4d6d-914a-9c753e984d0f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:06.853264 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d7ab7016-c547-4d6d-914a-9c753e984d0f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:06.859432 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d7ab7016-c547-4d6d-914a-9c753e984d0f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:06.859877 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d7ab7016-c547-4d6d-914a-9c753e984d0f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:06.860650 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d7ab7016-c547-4d6d-914a-9c753e984d0f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:06.861083 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d7ab7016-c547-4d6d-914a-9c753e984d0f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:06.874643 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-d7ab7016-c547-4d6d-914a-9c753e984d0f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] HTTP exception thrown: Instance 68310acb-6f2f-4a32-9b65-20ae91f67062 could not be found. Nov 24 15:28:06.875230 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d7ab7016-c547-4d6d-914a-9c753e984d0f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Returning 404 to user: Instance 68310acb-6f2f-4a32-9b65-20ae91f67062 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:28:06.876036 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d7ab7016-c547-4d6d-914a-9c753e984d0f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 404 len: 111 microversion: 2.1 time: 0.026972 Nov 24 15:28:06.876547 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 482/907] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:28:06 2021] DELETE /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:28:06.884574 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-dc2be5c7-c372-41e7-80e6-b1d55da99c1a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:06.885183 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-dc2be5c7-c372-41e7-80e6-b1d55da99c1a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 68310acb-6f2f-4a32-9b65-20ae91f67062] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:06.892270 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dc2be5c7-c372-41e7-80e6-b1d55da99c1a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:06.892716 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dc2be5c7-c372-41e7-80e6-b1d55da99c1a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:06.893490 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dc2be5c7-c372-41e7-80e6-b1d55da99c1a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:06.893923 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dc2be5c7-c372-41e7-80e6-b1d55da99c1a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:06.906567 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-dc2be5c7-c372-41e7-80e6-b1d55da99c1a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] HTTP exception thrown: Instance 68310acb-6f2f-4a32-9b65-20ae91f67062 could not be found. Nov 24 15:28:06.907174 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-dc2be5c7-c372-41e7-80e6-b1d55da99c1a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Returning 404 to user: Instance 68310acb-6f2f-4a32-9b65-20ae91f67062 could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:28:06.907985 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-dc2be5c7-c372-41e7-80e6-b1d55da99c1a tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062" status: 404 len: 111 microversion: 2.1 time: 0.027498 Nov 24 15:28:06.908515 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 426/908] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:06 2021] GET /compute/v2.1/servers/68310acb-6f2f-4a32-9b65-20ae91f67062 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:28:07.780168 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 15:28:07.780439 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: Wed Nov 24 15:28:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 15:28:08.031210 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-57ac80d4-f875-43a5-9077-e2f2881a669f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:08.031780 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-57ac80d4-f875-43a5-9077-e2f2881a669f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:08.039756 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-57ac80d4-f875-43a5-9077-e2f2881a669f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:08.040198 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-57ac80d4-f875-43a5-9077-e2f2881a669f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:08.040976 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-57ac80d4-f875-43a5-9077-e2f2881a669f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:08.041408 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-57ac80d4-f875-43a5-9077-e2f2881a669f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:08.055861 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-57ac80d4-f875-43a5-9077-e2f2881a669f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] HTTP exception thrown: Instance 361e1e6c-853b-4fde-89ed-843a85be79c1 could not be found. Nov 24 15:28:08.056444 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-57ac80d4-f875-43a5-9077-e2f2881a669f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Returning 404 to user: Instance 361e1e6c-853b-4fde-89ed-843a85be79c1 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:28:08.057261 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-57ac80d4-f875-43a5-9077-e2f2881a669f tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "DELETE /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 404 len: 111 microversion: 2.1 time: 0.029971 Nov 24 15:28:08.057815 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 483/909] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:28:08 2021] DELETE /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:28:08.066085 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-947d61f6-716c-4c50-99ab-9cc214112db5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:08.066692 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-947d61f6-716c-4c50-99ab-9cc214112db5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] [instance: 361e1e6c-853b-4fde-89ed-843a85be79c1] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:08.073041 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-947d61f6-716c-4c50-99ab-9cc214112db5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:08.073487 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-947d61f6-716c-4c50-99ab-9cc214112db5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:08.074257 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-947d61f6-716c-4c50-99ab-9cc214112db5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:08.074702 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-947d61f6-716c-4c50-99ab-9cc214112db5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:08.089142 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-947d61f6-716c-4c50-99ab-9cc214112db5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] HTTP exception thrown: Instance 361e1e6c-853b-4fde-89ed-843a85be79c1 could not be found. Nov 24 15:28:08.089714 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-947d61f6-716c-4c50-99ab-9cc214112db5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] Returning 404 to user: Instance 361e1e6c-853b-4fde-89ed-843a85be79c1 could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:28:08.090511 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-947d61f6-716c-4c50-99ab-9cc214112db5 tempest-AttachVolumeShelveTestJSON-433917209 tempest-AttachVolumeShelveTestJSON-433917209-project] 10.222.0.66 "GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1" status: 404 len: 111 microversion: 2.1 time: 0.028635 Nov 24 15:28:08.091067 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 427/910] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:08 2021] GET /compute/v2.1/servers/361e1e6c-853b-4fde-89ed-843a85be79c1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:28:13.157286 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-313964970", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452", "networks": [{"uuid": "aa867618-d47b-434c-83de-e2687c858c2a"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:28:13.218260 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] validate_networks() for [('aa867618-d47b-434c-83de-e2687c858c2a', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:28:13.557275 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:28:13.557688 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:28:13.558147 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:28:13.558546 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:28:13.558978 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:28:13.567905 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:13.568338 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:13.569136 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:13.569581 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:13.585630 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Getting quotas for project 334c8b40c125486ba3a4da48c4908263. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:28:13.589416 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Getting quotas for user ac9a46bfbc60461db2ab14f473c9a80e and project 334c8b40c125486ba3a4da48c4908263. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:28:13.599939 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:28:13.602181 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:28:13.648654 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e0fbb5f3-b8db-4943-a99c-b0eb5e0344be tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605412 Nov 24 15:28:13.649215 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 484/911] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:28:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:28:13.659012 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f8e75824-ffdf-4ab1-a40f-def7c1ac6d20 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:13.659623 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-f8e75824-ffdf-4ab1-a40f-def7c1ac6d20 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:13.711871 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-f8e75824-ffdf-4ab1-a40f-def7c1ac6d20 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:13.718524 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f8e75824-ffdf-4ab1-a40f-def7c1ac6d20 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132" status: 200 len: 1217 microversion: 2.1 time: 0.063287 Nov 24 15:28:13.719195 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 428/912] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:13 2021] GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:14.735658 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-62bbc3f6-f4e2-462f-8a4c-35a11ba08ebe tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:14.736251 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-62bbc3f6-f4e2-462f-8a4c-35a11ba08ebe tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:14.743325 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-62bbc3f6-f4e2-462f-8a4c-35a11ba08ebe tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:14.743776 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-62bbc3f6-f4e2-462f-8a4c-35a11ba08ebe tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:14.744593 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-62bbc3f6-f4e2-462f-8a4c-35a11ba08ebe tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:14.745030 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-62bbc3f6-f4e2-462f-8a4c-35a11ba08ebe tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:14.804925 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-62bbc3f6-f4e2-462f-8a4c-35a11ba08ebe tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:14.812458 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-62bbc3f6-f4e2-462f-8a4c-35a11ba08ebe tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132" status: 200 len: 1275 microversion: 2.1 time: 0.080819 Nov 24 15:28:14.813275 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 485/913] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:14 2021] GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132 => generated 1275 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:15.744407 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-26a2dec9-6b64-43ea-9946-869c96d226fe req-ee5c50a4-9a01-4883-b7b3-6e9ce7ea475b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef9112ee-7671-4710-858e-fd623de49132", "tag": "92eec736-e4cd-4ccf-be5a-8014d692c990"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:28:15.746583 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:28:15.746583 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:28:15.756760 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-26a2dec9-6b64-43ea-9946-869c96d226fe req-ee5c50a4-9a01-4883-b7b3-6e9ce7ea475b service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:15.757203 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-26a2dec9-6b64-43ea-9946-869c96d226fe req-ee5c50a4-9a01-4883-b7b3-6e9ce7ea475b service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:15.770798 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-26a2dec9-6b64-43ea-9946-869c96d226fe req-ee5c50a4-9a01-4883-b7b3-6e9ce7ea475b service nova] Creating event network-changed:92eec736-e4cd-4ccf-be5a-8014d692c990 for instance ef9112ee-7671-4710-858e-fd623de49132 on hv-cinder-80403 Nov 24 15:28:15.776266 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-26a2dec9-6b64-43ea-9946-869c96d226fe req-ee5c50a4-9a01-4883-b7b3-6e9ce7ea475b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035212 Nov 24 15:28:15.776859 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 429/914] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:28:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:28:15.829167 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6ccf8412-b1fa-4f5f-9c9b-730f78cd6810 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:15.829880 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6ccf8412-b1fa-4f5f-9c9b-730f78cd6810 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:15.836292 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6ccf8412-b1fa-4f5f-9c9b-730f78cd6810 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:15.836737 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6ccf8412-b1fa-4f5f-9c9b-730f78cd6810 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:15.837520 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6ccf8412-b1fa-4f5f-9c9b-730f78cd6810 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:15.837979 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6ccf8412-b1fa-4f5f-9c9b-730f78cd6810 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:15.968372 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6ccf8412-b1fa-4f5f-9c9b-730f78cd6810 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:15.976172 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6ccf8412-b1fa-4f5f-9c9b-730f78cd6810 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132" status: 200 len: 1317 microversion: 2.1 time: 0.150649 Nov 24 15:28:15.976737 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 486/915] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:15 2021] GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:16.994105 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-0ed637ae-50f5-4902-90bd-d90d145bc296 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:16.994939 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-0ed637ae-50f5-4902-90bd-d90d145bc296 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:17.002111 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0ed637ae-50f5-4902-90bd-d90d145bc296 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:17.002563 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0ed637ae-50f5-4902-90bd-d90d145bc296 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:17.003373 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0ed637ae-50f5-4902-90bd-d90d145bc296 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:17.003815 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0ed637ae-50f5-4902-90bd-d90d145bc296 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:17.139011 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-0ed637ae-50f5-4902-90bd-d90d145bc296 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:17.146256 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-0ed637ae-50f5-4902-90bd-d90d145bc296 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132" status: 200 len: 1317 microversion: 2.1 time: 0.156144 Nov 24 15:28:17.146826 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 430/916] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:16 2021] GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:18.162963 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0d86450e-123c-4c67-a569-2d73277e87cc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:18.163565 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0d86450e-123c-4c67-a569-2d73277e87cc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:18.169702 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d86450e-123c-4c67-a569-2d73277e87cc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:18.170147 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d86450e-123c-4c67-a569-2d73277e87cc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:18.170959 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d86450e-123c-4c67-a569-2d73277e87cc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:18.171393 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0d86450e-123c-4c67-a569-2d73277e87cc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:18.311678 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0d86450e-123c-4c67-a569-2d73277e87cc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:18.318828 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0d86450e-123c-4c67-a569-2d73277e87cc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132" status: 200 len: 1317 microversion: 2.1 time: 0.159497 Nov 24 15:28:18.319393 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 487/917] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:18 2021] GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:19.335930 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-918febee-79bc-458f-8122-0f3357c496a9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:19.336641 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-918febee-79bc-458f-8122-0f3357c496a9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:19.343063 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-918febee-79bc-458f-8122-0f3357c496a9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:19.343519 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-918febee-79bc-458f-8122-0f3357c496a9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:19.344389 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-918febee-79bc-458f-8122-0f3357c496a9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:19.344994 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-918febee-79bc-458f-8122-0f3357c496a9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:19.478590 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-918febee-79bc-458f-8122-0f3357c496a9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:19.486730 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-918febee-79bc-458f-8122-0f3357c496a9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132" status: 200 len: 1317 microversion: 2.1 time: 0.154519 Nov 24 15:28:19.487598 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 431/918] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:19 2021] GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:20.183801 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-1de5ece8-d526-42b8-b426-9d3d2d004735 req-32d5e466-8676-42ee-a585-ee1d18bff6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef9112ee-7671-4710-858e-fd623de49132", "name": "network-vif-plugged", "status": "completed", "tag": "92eec736-e4cd-4ccf-be5a-8014d692c990"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:28:20.186244 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:28:20.186244 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:28:20.193580 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1de5ece8-d526-42b8-b426-9d3d2d004735 req-32d5e466-8676-42ee-a585-ee1d18bff6e7 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:20.194161 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1de5ece8-d526-42b8-b426-9d3d2d004735 req-32d5e466-8676-42ee-a585-ee1d18bff6e7 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:20.207140 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-1de5ece8-d526-42b8-b426-9d3d2d004735 req-32d5e466-8676-42ee-a585-ee1d18bff6e7 service nova] Creating event network-vif-plugged:92eec736-e4cd-4ccf-be5a-8014d692c990 for instance ef9112ee-7671-4710-858e-fd623de49132 on hv-cinder-80403 Nov 24 15:28:20.212013 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-1de5ece8-d526-42b8-b426-9d3d2d004735 req-32d5e466-8676-42ee-a585-ee1d18bff6e7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032269 Nov 24 15:28:20.212597 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 488/919] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:28:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:28:20.504160 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-cbbe8939-1f1f-49fa-b76c-924544643ca9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:20.504769 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-cbbe8939-1f1f-49fa-b76c-924544643ca9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:20.511072 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cbbe8939-1f1f-49fa-b76c-924544643ca9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:20.511522 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cbbe8939-1f1f-49fa-b76c-924544643ca9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:20.512320 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cbbe8939-1f1f-49fa-b76c-924544643ca9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:20.512753 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cbbe8939-1f1f-49fa-b76c-924544643ca9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:20.641277 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-cbbe8939-1f1f-49fa-b76c-924544643ca9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:20.648551 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-cbbe8939-1f1f-49fa-b76c-924544643ca9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132" status: 200 len: 1317 microversion: 2.1 time: 0.148102 Nov 24 15:28:20.649115 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 432/920] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:20 2021] GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:21.666222 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-686afdad-803b-46a3-8a00-0a4e8240a362 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:21.666893 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-686afdad-803b-46a3-8a00-0a4e8240a362 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:21.673486 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-686afdad-803b-46a3-8a00-0a4e8240a362 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:21.673938 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-686afdad-803b-46a3-8a00-0a4e8240a362 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:21.674720 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-686afdad-803b-46a3-8a00-0a4e8240a362 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:21.675279 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-686afdad-803b-46a3-8a00-0a4e8240a362 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:21.804662 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-686afdad-803b-46a3-8a00-0a4e8240a362 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:21.811894 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-686afdad-803b-46a3-8a00-0a4e8240a362 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132" status: 200 len: 1508 microversion: 2.1 time: 0.150176 Nov 24 15:28:21.812464 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 489/921] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:21 2021] GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:23.144445 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-229a5151-ed3a-457c-b8f1-631a2cbbfe40 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0edcb8e9-7e1c-4d8e-994b-22a8532b9fc4"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:28:23.145485 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-229a5151-ed3a-457c-b8f1-631a2cbbfe40 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:23.151744 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-229a5151-ed3a-457c-b8f1-631a2cbbfe40 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:23.152194 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-229a5151-ed3a-457c-b8f1-631a2cbbfe40 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:23.152961 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-229a5151-ed3a-457c-b8f1-631a2cbbfe40 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:23.153397 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-229a5151-ed3a-457c-b8f1-631a2cbbfe40 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:23.381584 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-229a5151-ed3a-457c-b8f1-631a2cbbfe40 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "POST /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240638 Nov 24 15:28:23.382198 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 433/922] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Nov 24 15:28:23 2021] POST /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:28:29.827082 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-174178918", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452", "networks": [{"uuid": "aa867618-d47b-434c-83de-e2687c858c2a"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:28:29.877270 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] validate_networks() for [('aa867618-d47b-434c-83de-e2687c858c2a', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:28:30.235051 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:28:30.235490 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:28:30.235953 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:28:30.236355 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:28:30.236760 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:28:30.245597 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:30.246034 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:30.246854 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:30.247288 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:30.264851 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Getting quotas for project 334c8b40c125486ba3a4da48c4908263. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:28:30.268721 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Getting quotas for user ac9a46bfbc60461db2ab14f473c9a80e and project 334c8b40c125486ba3a4da48c4908263. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:28:30.279098 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:28:30.281390 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:28:30.325559 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-65c67eb2-bab7-4cc7-ae54-e8c455f48316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502886 Nov 24 15:28:30.326779 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 490/923] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:28:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 24 15:28:30.337559 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8d817bbe-cce3-4813-8447-2e49fbe317b7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:30.338229 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8d817bbe-cce3-4813-8447-2e49fbe317b7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:30.395010 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8d817bbe-cce3-4813-8447-2e49fbe317b7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:30.401671 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8d817bbe-cce3-4813-8447-2e49fbe317b7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0" status: 200 len: 1217 microversion: 2.1 time: 0.068513 Nov 24 15:28:30.402272 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 434/924] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:30 2021] GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:31.417738 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-bc9a801f-0c0b-4cab-bda5-574586bcc492 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:31.418344 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-bc9a801f-0c0b-4cab-bda5-574586bcc492 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:31.424719 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bc9a801f-0c0b-4cab-bda5-574586bcc492 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:31.425166 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bc9a801f-0c0b-4cab-bda5-574586bcc492 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:31.425938 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bc9a801f-0c0b-4cab-bda5-574586bcc492 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:31.426374 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-bc9a801f-0c0b-4cab-bda5-574586bcc492 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:31.487880 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-bc9a801f-0c0b-4cab-bda5-574586bcc492 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:31.495447 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-bc9a801f-0c0b-4cab-bda5-574586bcc492 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0" status: 200 len: 1275 microversion: 2.1 time: 0.081374 Nov 24 15:28:31.496102 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 491/925] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:31 2021] GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 => generated 1275 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:32.489149 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-bcb10e09-259b-4f2c-a608-8b7795fb483c req-6d22c200-548c-4b42-aed2-2879bb7840fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7550ec0-8dc1-4be7-aa6c-0747730a0ef0", "tag": "7fc3bdcc-ac1d-4a0d-b4a6-b9a0d99f789e"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:28:32.490678 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:28:32.490678 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:28:32.498760 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-bcb10e09-259b-4f2c-a608-8b7795fb483c req-6d22c200-548c-4b42-aed2-2879bb7840fa service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:32.499418 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-bcb10e09-259b-4f2c-a608-8b7795fb483c req-6d22c200-548c-4b42-aed2-2879bb7840fa service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:32.511367 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-bcb10e09-259b-4f2c-a608-8b7795fb483c req-6d22c200-548c-4b42-aed2-2879bb7840fa service nova] Creating event network-changed:7fc3bdcc-ac1d-4a0d-b4a6-b9a0d99f789e for instance e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 on hv-cinder-80403 Nov 24 15:28:32.513931 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-02b08133-6bf2-4c6d-91d9-55d65c236c34 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:32.515140 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-02b08133-6bf2-4c6d-91d9-55d65c236c34 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:32.516099 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-bcb10e09-259b-4f2c-a608-8b7795fb483c req-6d22c200-548c-4b42-aed2-2879bb7840fa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030831 Nov 24 15:28:32.516769 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 435/926] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:28:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:28:32.523006 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-02b08133-6bf2-4c6d-91d9-55d65c236c34 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:32.523451 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-02b08133-6bf2-4c6d-91d9-55d65c236c34 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:32.524232 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-02b08133-6bf2-4c6d-91d9-55d65c236c34 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:32.524664 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-02b08133-6bf2-4c6d-91d9-55d65c236c34 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:32.660883 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-02b08133-6bf2-4c6d-91d9-55d65c236c34 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:32.668191 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-02b08133-6bf2-4c6d-91d9-55d65c236c34 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0" status: 200 len: 1317 microversion: 2.1 time: 0.159015 Nov 24 15:28:32.668752 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 492/927] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:32 2021] GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:28:33.686320 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a816380f-b728-457e-8504-04ec58b28081 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:33.686966 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a816380f-b728-457e-8504-04ec58b28081 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:33.693064 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a816380f-b728-457e-8504-04ec58b28081 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:33.693509 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a816380f-b728-457e-8504-04ec58b28081 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:33.694281 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a816380f-b728-457e-8504-04ec58b28081 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:33.694713 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a816380f-b728-457e-8504-04ec58b28081 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:33.827595 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-a816380f-b728-457e-8504-04ec58b28081 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:33.834704 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a816380f-b728-457e-8504-04ec58b28081 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0" status: 200 len: 1317 microversion: 2.1 time: 0.153494 Nov 24 15:28:33.835299 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 436/928] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:33 2021] GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:34.851735 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f77ba840-78da-438a-a680-ef07da584c90 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:34.852347 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f77ba840-78da-438a-a680-ef07da584c90 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:34.858607 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f77ba840-78da-438a-a680-ef07da584c90 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:34.859082 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f77ba840-78da-438a-a680-ef07da584c90 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:34.859862 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f77ba840-78da-438a-a680-ef07da584c90 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:34.860281 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f77ba840-78da-438a-a680-ef07da584c90 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:34.991813 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f77ba840-78da-438a-a680-ef07da584c90 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:34.998994 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f77ba840-78da-438a-a680-ef07da584c90 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0" status: 200 len: 1317 microversion: 2.1 time: 0.150915 Nov 24 15:28:34.999552 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 493/929] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:34 2021] GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:36.015123 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-69f5f059-d010-4096-810d-a6e88a1a47cb tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:36.015827 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-69f5f059-d010-4096-810d-a6e88a1a47cb tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:36.021940 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-69f5f059-d010-4096-810d-a6e88a1a47cb tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:36.022386 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-69f5f059-d010-4096-810d-a6e88a1a47cb tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:36.023188 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-69f5f059-d010-4096-810d-a6e88a1a47cb tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:36.023622 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-69f5f059-d010-4096-810d-a6e88a1a47cb tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:36.151103 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-69f5f059-d010-4096-810d-a6e88a1a47cb tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:36.158263 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-69f5f059-d010-4096-810d-a6e88a1a47cb tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0" status: 200 len: 1317 microversion: 2.1 time: 0.147437 Nov 24 15:28:36.159048 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 437/930] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:36 2021] GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:37.174800 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8420e8b5-479d-44b9-ae25-c6adafc2a6f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:37.175414 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8420e8b5-479d-44b9-ae25-c6adafc2a6f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:37.181604 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8420e8b5-479d-44b9-ae25-c6adafc2a6f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:37.182044 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8420e8b5-479d-44b9-ae25-c6adafc2a6f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:37.182818 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8420e8b5-479d-44b9-ae25-c6adafc2a6f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:37.183255 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8420e8b5-479d-44b9-ae25-c6adafc2a6f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:37.317782 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8420e8b5-479d-44b9-ae25-c6adafc2a6f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:37.325124 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8420e8b5-479d-44b9-ae25-c6adafc2a6f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0" status: 200 len: 1317 microversion: 2.1 time: 0.153782 Nov 24 15:28:37.325679 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 494/931] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:37 2021] GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:38.294532 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-047b5803-22c4-48b4-9d99-9764bd909eb1 req-f45feb03-8ac3-425a-a4d8-a84870cf0643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7550ec0-8dc1-4be7-aa6c-0747730a0ef0", "name": "network-vif-plugged", "status": "completed", "tag": "7fc3bdcc-ac1d-4a0d-b4a6-b9a0d99f789e"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:28:38.296858 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:28:38.296858 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:28:38.304362 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-047b5803-22c4-48b4-9d99-9764bd909eb1 req-f45feb03-8ac3-425a-a4d8-a84870cf0643 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:38.304862 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-047b5803-22c4-48b4-9d99-9764bd909eb1 req-f45feb03-8ac3-425a-a4d8-a84870cf0643 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:38.316631 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-047b5803-22c4-48b4-9d99-9764bd909eb1 req-f45feb03-8ac3-425a-a4d8-a84870cf0643 service nova] Creating event network-vif-plugged:7fc3bdcc-ac1d-4a0d-b4a6-b9a0d99f789e for instance e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 on hv-cinder-80403 Nov 24 15:28:38.321314 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-047b5803-22c4-48b4-9d99-9764bd909eb1 req-f45feb03-8ac3-425a-a4d8-a84870cf0643 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030496 Nov 24 15:28:38.321902 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 438/932] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:28:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:28:38.341819 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6e317dca-9e73-49b2-ad27-462d30d26f5f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:38.343308 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6e317dca-9e73-49b2-ad27-462d30d26f5f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:38.349531 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e317dca-9e73-49b2-ad27-462d30d26f5f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:38.350426 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e317dca-9e73-49b2-ad27-462d30d26f5f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:38.350769 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e317dca-9e73-49b2-ad27-462d30d26f5f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:38.351264 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6e317dca-9e73-49b2-ad27-462d30d26f5f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:38.490382 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6e317dca-9e73-49b2-ad27-462d30d26f5f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:38.497811 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6e317dca-9e73-49b2-ad27-462d30d26f5f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0" status: 200 len: 1317 microversion: 2.1 time: 0.160149 Nov 24 15:28:38.501330 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 495/933] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:38 2021] GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:39.516550 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-e1db2ac9-433b-49f0-98b0-198e310ec77e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:39.517243 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-e1db2ac9-433b-49f0-98b0-198e310ec77e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:39.523342 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e1db2ac9-433b-49f0-98b0-198e310ec77e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:39.523790 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e1db2ac9-433b-49f0-98b0-198e310ec77e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:39.524554 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e1db2ac9-433b-49f0-98b0-198e310ec77e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:39.524979 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e1db2ac9-433b-49f0-98b0-198e310ec77e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:39.658491 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e1db2ac9-433b-49f0-98b0-198e310ec77e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:39.665977 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-e1db2ac9-433b-49f0-98b0-198e310ec77e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0" status: 200 len: 1317 microversion: 2.1 time: 0.154770 Nov 24 15:28:39.666551 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 439/934] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:39 2021] GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:40.682683 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a6dbae3b-016d-4e31-9702-d93e5fe23857 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:40.683257 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a6dbae3b-016d-4e31-9702-d93e5fe23857 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:40.689444 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6dbae3b-016d-4e31-9702-d93e5fe23857 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:40.689883 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6dbae3b-016d-4e31-9702-d93e5fe23857 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:40.690680 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6dbae3b-016d-4e31-9702-d93e5fe23857 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:40.691143 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a6dbae3b-016d-4e31-9702-d93e5fe23857 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:40.820613 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a6dbae3b-016d-4e31-9702-d93e5fe23857 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:40.827811 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a6dbae3b-016d-4e31-9702-d93e5fe23857 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0" status: 200 len: 1508 microversion: 2.1 time: 0.148881 Nov 24 15:28:40.828379 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 496/935] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:40 2021] GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:40.844069 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-830c0c0e-1846-4224-9459-8864993bc40b tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0edcb8e9-7e1c-4d8e-994b-22a8532b9fc4"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:28:40.845114 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-830c0c0e-1846-4224-9459-8864993bc40b tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:40.851434 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-830c0c0e-1846-4224-9459-8864993bc40b tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:40.851883 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-830c0c0e-1846-4224-9459-8864993bc40b tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:40.852651 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-830c0c0e-1846-4224-9459-8864993bc40b tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:40.853086 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-830c0c0e-1846-4224-9459-8864993bc40b tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:40.928301 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-830c0c0e-1846-4224-9459-8864993bc40b tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] HTTP exception thrown: Invalid volume: volume 0edcb8e9-7e1c-4d8e-994b-22a8532b9fc4 is already attached to instances: ef9112ee-7671-4710-858e-fd623de49132 Nov 24 15:28:40.928997 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-830c0c0e-1846-4224-9459-8864993bc40b tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Returning 400 to user: Invalid volume: volume 0edcb8e9-7e1c-4d8e-994b-22a8532b9fc4 is already attached to instances: ef9112ee-7671-4710-858e-fd623de49132 {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:28:40.929821 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-830c0c0e-1846-4224-9459-8864993bc40b tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "POST /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.089801 Nov 24 15:28:40.930360 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 440/936] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Nov 24 15:28:40 2021] POST /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0/os-volume_attachments => generated 174 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 24 15:28:40.987281 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-93d836c1-3a9f-4e78-a5f9-b1fd25f42673 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:40.987769 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-93d836c1-3a9f-4e78-a5f9-b1fd25f42673 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:40.993769 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-93d836c1-3a9f-4e78-a5f9-b1fd25f42673 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:40.994212 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-93d836c1-3a9f-4e78-a5f9-b1fd25f42673 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:40.995016 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-93d836c1-3a9f-4e78-a5f9-b1fd25f42673 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:40.995444 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-93d836c1-3a9f-4e78-a5f9-b1fd25f42673 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:41.072056 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-93d836c1-3a9f-4e78-a5f9-b1fd25f42673 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lazy-loading 'services' on Instance uuid ef9112ee-7671-4710-858e-fd623de49132 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:28:41.139664 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-93d836c1-3a9f-4e78-a5f9-b1fd25f42673 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132/os-volume_attachments/0edcb8e9-7e1c-4d8e-994b-22a8532b9fc4" status: 202 len: 0 microversion: 2.1 time: 0.156399 Nov 24 15:28:41.140302 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 497/937] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Nov 24 15:28:40 2021] DELETE /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132/os-volume_attachments/0edcb8e9-7e1c-4d8e-994b-22a8532b9fc4 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:28:41.148211 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-26740ab0-4dab-4ab9-ac82-23f2571ca431 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:41.149111 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-26740ab0-4dab-4ab9-ac82-23f2571ca431 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:41.155779 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-26740ab0-4dab-4ab9-ac82-23f2571ca431 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:41.156225 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-26740ab0-4dab-4ab9-ac82-23f2571ca431 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:41.156997 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-26740ab0-4dab-4ab9-ac82-23f2571ca431 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:41.157430 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-26740ab0-4dab-4ab9-ac82-23f2571ca431 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:41.189752 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-26740ab0-4dab-4ab9-ac82-23f2571ca431 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045047 Nov 24 15:28:41.190327 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 441/938] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:28:41 2021] GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:28:42.203014 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-22c99498-2a41-432c-9e6d-a5b98510758a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:42.204054 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-22c99498-2a41-432c-9e6d-a5b98510758a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:42.210076 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-22c99498-2a41-432c-9e6d-a5b98510758a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:42.210518 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-22c99498-2a41-432c-9e6d-a5b98510758a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:42.211305 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-22c99498-2a41-432c-9e6d-a5b98510758a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:42.211733 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-22c99498-2a41-432c-9e6d-a5b98510758a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:42.239373 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-22c99498-2a41-432c-9e6d-a5b98510758a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041729 Nov 24 15:28:42.239921 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 498/939] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:28:42 2021] GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:28:42.336783 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-490066426", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452", "networks": [{"uuid": "aa867618-d47b-434c-83de-e2687c858c2a"}]}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:28:42.387649 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.network.neutron [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] validate_networks() for [('aa867618-d47b-434c-83de-e2687c858c2a', None, None, None, None, None)] {{(pid=116073) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:28:42.749781 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Flavor limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:28:42.750498 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Image limits 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:28:42.750778 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Flavor pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:28:42.751214 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Image pref 0:0:0 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:28:42.751623 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.virt.hardware [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116073) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:28:42.760181 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:42.760656 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:42.761466 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:42.761899 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:42.777971 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Getting quotas for project 334c8b40c125486ba3a4da48c4908263. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:28:42.782386 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Getting quotas for user ac9a46bfbc60461db2ab14f473c9a80e and project 334c8b40c125486ba3a4da48c4908263. Resources: {'ram', 'cores', 'instances'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:28:42.793078 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Going to run 1 instances... {{(pid=116073) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:28:42.796702 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116073) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:28:42.840080 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c2cfa09b-9127-4500-bd83-f70c396688a0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506869 Nov 24 15:28:42.840897 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 442/940] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:28:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:28:42.850879 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ab558ab5-98de-4fab-b59b-c608039ed869 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:42.851309 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ab558ab5-98de-4fab-b59b-c608039ed869 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:42.916698 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ab558ab5-98de-4fab-b59b-c608039ed869 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:42.924317 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ab558ab5-98de-4fab-b59b-c608039ed869 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b" status: 200 len: 1217 microversion: 2.1 time: 0.077120 Nov 24 15:28:42.925207 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 499/941] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:42 2021] GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:43.942135 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-da7a8918-2a44-4ba4-9784-1788ae175026 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:43.942743 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-da7a8918-2a44-4ba4-9784-1788ae175026 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:43.948881 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-da7a8918-2a44-4ba4-9784-1788ae175026 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:43.949334 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-da7a8918-2a44-4ba4-9784-1788ae175026 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:43.950124 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-da7a8918-2a44-4ba4-9784-1788ae175026 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:43.950568 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-da7a8918-2a44-4ba4-9784-1788ae175026 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:44.012076 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-da7a8918-2a44-4ba4-9784-1788ae175026 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:44.019396 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-da7a8918-2a44-4ba4-9784-1788ae175026 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b" status: 200 len: 1275 microversion: 2.1 time: 0.081303 Nov 24 15:28:44.019990 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 443/942] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:43 2021] GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b => generated 1275 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:45.005374 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-c03b48af-2e1f-41d7-8d61-d6fd921e5b04 req-db2af119-0aa8-4b30-a832-5b47eb0fd37a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e64a4011-c8a2-4021-bbb2-ef5886c1c12b", "tag": "50d1a0ec-16c2-441e-8145-73d64751ca07"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:28:45.006981 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:28:45.006981 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:28:45.015892 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-c03b48af-2e1f-41d7-8d61-d6fd921e5b04 req-db2af119-0aa8-4b30-a832-5b47eb0fd37a service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:45.016337 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-c03b48af-2e1f-41d7-8d61-d6fd921e5b04 req-db2af119-0aa8-4b30-a832-5b47eb0fd37a service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:45.027177 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-c03b48af-2e1f-41d7-8d61-d6fd921e5b04 req-db2af119-0aa8-4b30-a832-5b47eb0fd37a service nova] Creating event network-changed:50d1a0ec-16c2-441e-8145-73d64751ca07 for instance e64a4011-c8a2-4021-bbb2-ef5886c1c12b on hv-cinder-80403 Nov 24 15:28:45.032162 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-c03b48af-2e1f-41d7-8d61-d6fd921e5b04 req-db2af119-0aa8-4b30-a832-5b47eb0fd37a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030293 Nov 24 15:28:45.032768 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 500/943] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:28:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:28:45.036765 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-e3a1d37c-1b5d-41b8-b4d3-725c650f3720 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:45.037373 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-e3a1d37c-1b5d-41b8-b4d3-725c650f3720 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:45.045835 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e3a1d37c-1b5d-41b8-b4d3-725c650f3720 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:45.046282 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e3a1d37c-1b5d-41b8-b4d3-725c650f3720 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:45.047112 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e3a1d37c-1b5d-41b8-b4d3-725c650f3720 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:45.047528 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-e3a1d37c-1b5d-41b8-b4d3-725c650f3720 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:45.184880 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-e3a1d37c-1b5d-41b8-b4d3-725c650f3720 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:45.192792 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-e3a1d37c-1b5d-41b8-b4d3-725c650f3720 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b" status: 200 len: 1317 microversion: 2.1 time: 0.159640 Nov 24 15:28:45.203396 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 444/944] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:45 2021] GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:46.211261 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-eecfd113-2848-4f79-9fcf-73f0faff5589 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:46.211864 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-eecfd113-2848-4f79-9fcf-73f0faff5589 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:46.218539 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eecfd113-2848-4f79-9fcf-73f0faff5589 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:46.219016 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eecfd113-2848-4f79-9fcf-73f0faff5589 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:46.219783 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eecfd113-2848-4f79-9fcf-73f0faff5589 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:46.220214 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-eecfd113-2848-4f79-9fcf-73f0faff5589 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:46.348334 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-eecfd113-2848-4f79-9fcf-73f0faff5589 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:46.355483 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-eecfd113-2848-4f79-9fcf-73f0faff5589 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b" status: 200 len: 1317 microversion: 2.1 time: 0.148849 Nov 24 15:28:46.356048 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 501/945] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:46 2021] GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:47.372307 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a8a0b0f6-ed73-442d-a8cd-fb70483db137 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:47.372914 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a8a0b0f6-ed73-442d-a8cd-fb70483db137 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:47.379775 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a8a0b0f6-ed73-442d-a8cd-fb70483db137 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:47.380223 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a8a0b0f6-ed73-442d-a8cd-fb70483db137 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:47.380994 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a8a0b0f6-ed73-442d-a8cd-fb70483db137 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:47.381427 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a8a0b0f6-ed73-442d-a8cd-fb70483db137 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:47.512625 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-a8a0b0f6-ed73-442d-a8cd-fb70483db137 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:47.520460 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a8a0b0f6-ed73-442d-a8cd-fb70483db137 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b" status: 200 len: 1317 microversion: 2.1 time: 0.151778 Nov 24 15:28:47.521021 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 445/946] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:47 2021] GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:48.537308 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b1b6deee-cfe3-4bbd-bd66-bb2beaf1d35a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:48.537906 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b1b6deee-cfe3-4bbd-bd66-bb2beaf1d35a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:48.544329 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1b6deee-cfe3-4bbd-bd66-bb2beaf1d35a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:48.544769 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1b6deee-cfe3-4bbd-bd66-bb2beaf1d35a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:48.545529 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1b6deee-cfe3-4bbd-bd66-bb2beaf1d35a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:48.545958 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b1b6deee-cfe3-4bbd-bd66-bb2beaf1d35a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:48.674306 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b1b6deee-cfe3-4bbd-bd66-bb2beaf1d35a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:48.681646 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b1b6deee-cfe3-4bbd-bd66-bb2beaf1d35a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b" status: 200 len: 1317 microversion: 2.1 time: 0.147989 Nov 24 15:28:48.682223 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 502/947] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:48 2021] GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:49.698897 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ea0e4735-9271-4b12-83dd-464e4138f3e7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:49.699415 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-ea0e4735-9271-4b12-83dd-464e4138f3e7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:49.705693 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ea0e4735-9271-4b12-83dd-464e4138f3e7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:49.706145 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ea0e4735-9271-4b12-83dd-464e4138f3e7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:49.706946 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ea0e4735-9271-4b12-83dd-464e4138f3e7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:49.707385 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-ea0e4735-9271-4b12-83dd-464e4138f3e7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:49.841359 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-ea0e4735-9271-4b12-83dd-464e4138f3e7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:49.849372 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ea0e4735-9271-4b12-83dd-464e4138f3e7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b" status: 200 len: 1317 microversion: 2.1 time: 0.154225 Nov 24 15:28:49.849940 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 446/948] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:49 2021] GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:50.362110 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-afae0c20-537b-4832-9af4-86cf76c6f11f req-285e0d03-211e-47c6-bfb8-5a65e73d91bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e64a4011-c8a2-4021-bbb2-ef5886c1c12b", "name": "network-vif-plugged", "status": "completed", "tag": "50d1a0ec-16c2-441e-8145-73d64751ca07"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:28:50.363999 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:28:50.363999 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:28:50.371333 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-afae0c20-537b-4832-9af4-86cf76c6f11f req-285e0d03-211e-47c6-bfb8-5a65e73d91bd service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:50.371884 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-afae0c20-537b-4832-9af4-86cf76c6f11f req-285e0d03-211e-47c6-bfb8-5a65e73d91bd service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:50.383521 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-afae0c20-537b-4832-9af4-86cf76c6f11f req-285e0d03-211e-47c6-bfb8-5a65e73d91bd service nova] Creating event network-vif-plugged:50d1a0ec-16c2-441e-8145-73d64751ca07 for instance e64a4011-c8a2-4021-bbb2-ef5886c1c12b on hv-cinder-80403 Nov 24 15:28:50.388351 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-afae0c20-537b-4832-9af4-86cf76c6f11f req-285e0d03-211e-47c6-bfb8-5a65e73d91bd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029778 Nov 24 15:28:50.388942 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 503/949] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:28:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:28:50.866664 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-bbb323d2-05f1-44fa-bcbd-7ec7101780b7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:50.867216 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-bbb323d2-05f1-44fa-bcbd-7ec7101780b7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:50.873615 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bbb323d2-05f1-44fa-bcbd-7ec7101780b7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:50.874088 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bbb323d2-05f1-44fa-bcbd-7ec7101780b7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:50.874889 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bbb323d2-05f1-44fa-bcbd-7ec7101780b7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:50.875365 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bbb323d2-05f1-44fa-bcbd-7ec7101780b7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:51.008362 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-bbb323d2-05f1-44fa-bcbd-7ec7101780b7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:51.015586 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-bbb323d2-05f1-44fa-bcbd-7ec7101780b7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b" status: 200 len: 1317 microversion: 2.1 time: 0.152871 Nov 24 15:28:51.016180 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 447/950] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:50 2021] GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:52.033797 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-84bbb7da-51f7-40db-8481-a8543f07cb38 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:28:52.034478 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-84bbb7da-51f7-40db-8481-a8543f07cb38 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:52.040661 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84bbb7da-51f7-40db-8481-a8543f07cb38 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:52.041102 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84bbb7da-51f7-40db-8481-a8543f07cb38 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:52.041864 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84bbb7da-51f7-40db-8481-a8543f07cb38 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:52.042292 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-84bbb7da-51f7-40db-8481-a8543f07cb38 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:52.169578 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-84bbb7da-51f7-40db-8481-a8543f07cb38 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:28:52.176730 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-84bbb7da-51f7-40db-8481-a8543f07cb38 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b" status: 200 len: 1507 microversion: 2.1 time: 0.147910 Nov 24 15:28:52.177291 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 504/951] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:28:52 2021] GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:28:53.478592 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-5c2f2c85-34d4-49af-a334-86b2dfdd7316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b53e9aad-2bae-4835-b0e4-2b0ebebe242c"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:28:53.479715 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-5c2f2c85-34d4-49af-a334-86b2dfdd7316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:28:53.486223 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c2f2c85-34d4-49af-a334-86b2dfdd7316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:53.486669 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c2f2c85-34d4-49af-a334-86b2dfdd7316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:53.487461 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c2f2c85-34d4-49af-a334-86b2dfdd7316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:28:53.488145 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-5c2f2c85-34d4-49af-a334-86b2dfdd7316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:28:53.715821 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-5c2f2c85-34d4-49af-a334-86b2dfdd7316 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "POST /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240827 Nov 24 15:28:53.716427 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 448/952] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Nov 24 15:28:53 2021] POST /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b/os-volume_attachments => generated 194 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:01.179133 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d4083ba6-e159-429a-8d62-33aa5888eb4a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b53e9aad-2bae-4835-b0e4-2b0ebebe242c"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:29:01.180131 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d4083ba6-e159-429a-8d62-33aa5888eb4a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:01.186255 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d4083ba6-e159-429a-8d62-33aa5888eb4a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:01.186695 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d4083ba6-e159-429a-8d62-33aa5888eb4a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:01.187525 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d4083ba6-e159-429a-8d62-33aa5888eb4a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:01.187949 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d4083ba6-e159-429a-8d62-33aa5888eb4a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:01.268101 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-d4083ba6-e159-429a-8d62-33aa5888eb4a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] HTTP exception thrown: Invalid volume: volume b53e9aad-2bae-4835-b0e4-2b0ebebe242c is already attached to instances: e64a4011-c8a2-4021-bbb2-ef5886c1c12b Nov 24 15:29:01.268703 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d4083ba6-e159-429a-8d62-33aa5888eb4a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Returning 400 to user: Invalid volume: volume b53e9aad-2bae-4835-b0e4-2b0ebebe242c is already attached to instances: e64a4011-c8a2-4021-bbb2-ef5886c1c12b {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:29:01.269537 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d4083ba6-e159-429a-8d62-33aa5888eb4a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "POST /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094350 Nov 24 15:29:01.270272 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 505/953] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Nov 24 15:29:01 2021] POST /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 24 15:29:01.327291 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-530e58f5-3de2-4e0d-a2dc-835bf8f7d92e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:01.328917 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-530e58f5-3de2-4e0d-a2dc-835bf8f7d92e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:01.335133 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-530e58f5-3de2-4e0d-a2dc-835bf8f7d92e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:01.335580 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-530e58f5-3de2-4e0d-a2dc-835bf8f7d92e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:01.336365 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-530e58f5-3de2-4e0d-a2dc-835bf8f7d92e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:01.336795 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-530e58f5-3de2-4e0d-a2dc-835bf8f7d92e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:01.425547 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-530e58f5-3de2-4e0d-a2dc-835bf8f7d92e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lazy-loading 'services' on Instance uuid e64a4011-c8a2-4021-bbb2-ef5886c1c12b {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:29:01.501112 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-530e58f5-3de2-4e0d-a2dc-835bf8f7d92e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b/os-volume_attachments/b53e9aad-2bae-4835-b0e4-2b0ebebe242c" status: 202 len: 0 microversion: 2.1 time: 0.178146 Nov 24 15:29:01.502113 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 449/954] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Nov 24 15:29:01 2021] DELETE /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b/os-volume_attachments/b53e9aad-2bae-4835-b0e4-2b0ebebe242c => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:29:01.512157 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ed7f7cef-801d-46ee-ae15-90c55d5380ed tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:01.513403 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ed7f7cef-801d-46ee-ae15-90c55d5380ed tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:01.523505 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ed7f7cef-801d-46ee-ae15-90c55d5380ed tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:01.524098 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ed7f7cef-801d-46ee-ae15-90c55d5380ed tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:01.525087 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ed7f7cef-801d-46ee-ae15-90c55d5380ed tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:01.525695 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ed7f7cef-801d-46ee-ae15-90c55d5380ed tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:01.562999 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ed7f7cef-801d-46ee-ae15-90c55d5380ed tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054832 Nov 24 15:29:01.563755 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 506/955] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:29:01 2021] GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:02.070731 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2d0e4e42-f0d5-4357-820a-8a615c4bde74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:02.071334 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2d0e4e42-f0d5-4357-820a-8a615c4bde74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:02.073479 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-d76e892a-633f-402d-a6ec-efa828b7b6a6 req-5e49dc15-6ff3-40cd-96d9-8a2302a15c54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b89769a5-ef2a-400a-9c59-3053f647e3c2", "tag": "2acc53e6-5fad-45de-9695-638ed83c9206"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:29:02.075053 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:29:02.075053 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:29:02.078372 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2d0e4e42-f0d5-4357-820a-8a615c4bde74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:02.078840 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2d0e4e42-f0d5-4357-820a-8a615c4bde74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:02.079637 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2d0e4e42-f0d5-4357-820a-8a615c4bde74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:02.080069 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2d0e4e42-f0d5-4357-820a-8a615c4bde74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:02.082976 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-d76e892a-633f-402d-a6ec-efa828b7b6a6 req-5e49dc15-6ff3-40cd-96d9-8a2302a15c54 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:02.083788 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-d76e892a-633f-402d-a6ec-efa828b7b6a6 req-5e49dc15-6ff3-40cd-96d9-8a2302a15c54 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:02.095489 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-d76e892a-633f-402d-a6ec-efa828b7b6a6 req-5e49dc15-6ff3-40cd-96d9-8a2302a15c54 service nova] Creating event network-changed:2acc53e6-5fad-45de-9695-638ed83c9206 for instance b89769a5-ef2a-400a-9c59-3053f647e3c2 on hv-cinder-80403 Nov 24 15:29:02.101386 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-d76e892a-633f-402d-a6ec-efa828b7b6a6 req-5e49dc15-6ff3-40cd-96d9-8a2302a15c54 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031541 Nov 24 15:29:02.102191 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 507/956] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:29:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:02.109835 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2d0e4e42-f0d5-4357-820a-8a615c4bde74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Going to try to terminate instance {{(pid=116073) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:29:02.192561 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2d0e4e42-f0d5-4357-820a-8a615c4bde74 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 204 len: 0 microversion: 2.1 time: 0.125282 Nov 24 15:29:02.193809 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 450/957] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:29:02 2021] DELETE /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:29:02.203528 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-44144dba-d852-494e-9a4b-b6297d13e1c4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:02.204983 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-44144dba-d852-494e-9a4b-b6297d13e1c4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:02.211729 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-44144dba-d852-494e-9a4b-b6297d13e1c4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:02.212414 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-44144dba-d852-494e-9a4b-b6297d13e1c4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:02.213207 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-44144dba-d852-494e-9a4b-b6297d13e1c4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:02.213652 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-44144dba-d852-494e-9a4b-b6297d13e1c4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:02.368019 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-44144dba-d852-494e-9a4b-b6297d13e1c4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:02.376466 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-44144dba-d852-494e-9a4b-b6297d13e1c4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1579 microversion: 2.1 time: 0.178183 Nov 24 15:29:02.377037 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 508/958] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:02 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1579 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:02.576347 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-bc4648ef-2a2f-4c78-a1e3-e481007c44b4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:02.576945 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-bc4648ef-2a2f-4c78-a1e3-e481007c44b4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:02.583561 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bc4648ef-2a2f-4c78-a1e3-e481007c44b4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:02.584018 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bc4648ef-2a2f-4c78-a1e3-e481007c44b4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:02.584814 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bc4648ef-2a2f-4c78-a1e3-e481007c44b4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:02.585257 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-bc4648ef-2a2f-4c78-a1e3-e481007c44b4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:02.618029 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-bc4648ef-2a2f-4c78-a1e3-e481007c44b4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046833 Nov 24 15:29:02.618632 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 451/959] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:29:02 2021] GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 24 15:29:02.719786 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-738753923", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452", "networks": [{"uuid": "aa867618-d47b-434c-83de-e2687c858c2a"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:29:02.771530 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] validate_networks() for [('aa867618-d47b-434c-83de-e2687c858c2a', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:29:03.365314 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:29:03.365826 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:29:03.366177 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:29:03.366577 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:29:03.367081 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:29:03.376217 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:03.377404 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:03.377541 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:03.377914 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:03.393771 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-377995bc-53ea-44e4-9d13-1907aab88f3a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:03.394376 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-377995bc-53ea-44e4-9d13-1907aab88f3a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:03.394854 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Getting quotas for project 334c8b40c125486ba3a4da48c4908263. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:29:03.398734 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Getting quotas for user ac9a46bfbc60461db2ab14f473c9a80e and project 334c8b40c125486ba3a4da48c4908263. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:29:03.400205 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-377995bc-53ea-44e4-9d13-1907aab88f3a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:03.400656 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-377995bc-53ea-44e4-9d13-1907aab88f3a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:03.401431 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-377995bc-53ea-44e4-9d13-1907aab88f3a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:03.401863 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-377995bc-53ea-44e4-9d13-1907aab88f3a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:03.410346 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:29:03.412952 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:29:03.457403 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3717dbf3-da44-4e3d-a29f-a512a02338d7 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741322 Nov 24 15:29:03.458054 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 509/960] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:29:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:29:03.467469 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-284ba275-3d81-45f0-9767-e87a1f0bc2ed tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:03.468728 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-284ba275-3d81-45f0-9767-e87a1f0bc2ed tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:03.530295 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-284ba275-3d81-45f0-9767-e87a1f0bc2ed tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:03.537916 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-284ba275-3d81-45f0-9767-e87a1f0bc2ed tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99" status: 200 len: 1217 microversion: 2.1 time: 0.073874 Nov 24 15:29:03.538825 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 510/961] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:03 2021] GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:29:03.567609 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-377995bc-53ea-44e4-9d13-1907aab88f3a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:03.574971 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-377995bc-53ea-44e4-9d13-1907aab88f3a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1460 microversion: 2.1 time: 0.185335 Nov 24 15:29:03.575543 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 452/962] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:03 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1460 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:04.448665 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-8ebd5e43-180a-47da-af6b-e7aef069b9e3 req-887ffd16-29c1-4cc3-aa8b-9440ac70b85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b89769a5-ef2a-400a-9c59-3053f647e3c2", "name": "network-vif-deleted", "tag": "2acc53e6-5fad-45de-9695-638ed83c9206"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:29:04.450791 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:29:04.450791 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:29:04.459725 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-8ebd5e43-180a-47da-af6b-e7aef069b9e3 req-887ffd16-29c1-4cc3-aa8b-9440ac70b85d service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:04.460265 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-8ebd5e43-180a-47da-af6b-e7aef069b9e3 req-887ffd16-29c1-4cc3-aa8b-9440ac70b85d service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:04.472367 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-8ebd5e43-180a-47da-af6b-e7aef069b9e3 req-887ffd16-29c1-4cc3-aa8b-9440ac70b85d service nova] Creating event network-vif-deleted:2acc53e6-5fad-45de-9695-638ed83c9206 for instance b89769a5-ef2a-400a-9c59-3053f647e3c2 on hv-cinder-80403 Nov 24 15:29:04.477198 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-8ebd5e43-180a-47da-af6b-e7aef069b9e3 req-887ffd16-29c1-4cc3-aa8b-9440ac70b85d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032826 Nov 24 15:29:04.477876 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 511/963] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:29:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:04.555930 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-22d95236-592d-4898-9b79-c39c45a02e67 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:04.556625 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-22d95236-592d-4898-9b79-c39c45a02e67 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:04.563632 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-22d95236-592d-4898-9b79-c39c45a02e67 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:04.564533 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-22d95236-592d-4898-9b79-c39c45a02e67 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:04.565740 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-22d95236-592d-4898-9b79-c39c45a02e67 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:04.566522 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-22d95236-592d-4898-9b79-c39c45a02e67 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:04.592531 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-90692d82-7460-451e-b8f6-4e4e342438fd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:04.593879 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-90692d82-7460-451e-b8f6-4e4e342438fd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:04.600610 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-90692d82-7460-451e-b8f6-4e4e342438fd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:04.601072 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-90692d82-7460-451e-b8f6-4e4e342438fd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:04.601861 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-90692d82-7460-451e-b8f6-4e4e342438fd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:04.602288 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-90692d82-7460-451e-b8f6-4e4e342438fd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:04.632635 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-22d95236-592d-4898-9b79-c39c45a02e67 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:04.641532 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-22d95236-592d-4898-9b79-c39c45a02e67 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99" status: 200 len: 1275 microversion: 2.1 time: 0.089890 Nov 24 15:29:04.642119 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 453/964] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:04 2021] GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99 => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:04.676966 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-90692d82-7460-451e-b8f6-4e4e342438fd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:04.685342 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-90692d82-7460-451e-b8f6-4e4e342438fd tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 200 len: 1226 microversion: 2.1 time: 0.097010 Nov 24 15:29:04.687187 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 512/965] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:04 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:29:05.658661 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a51cec55-8ca7-4c60-a6ef-39f46962c3d9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:05.659384 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a51cec55-8ca7-4c60-a6ef-39f46962c3d9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:05.665717 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a51cec55-8ca7-4c60-a6ef-39f46962c3d9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:05.666159 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a51cec55-8ca7-4c60-a6ef-39f46962c3d9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:05.666953 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a51cec55-8ca7-4c60-a6ef-39f46962c3d9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:05.667384 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a51cec55-8ca7-4c60-a6ef-39f46962c3d9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:05.703992 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-24f8c41f-8e4b-4474-b0fe-31919190601a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:05.704652 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-24f8c41f-8e4b-4474-b0fe-31919190601a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: b89769a5-ef2a-400a-9c59-3053f647e3c2] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:05.711594 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-24f8c41f-8e4b-4474-b0fe-31919190601a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:05.712039 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-24f8c41f-8e4b-4474-b0fe-31919190601a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:05.712847 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-24f8c41f-8e4b-4474-b0fe-31919190601a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:05.713276 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-24f8c41f-8e4b-4474-b0fe-31919190601a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:05.727942 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-24f8c41f-8e4b-4474-b0fe-31919190601a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] HTTP exception thrown: Instance b89769a5-ef2a-400a-9c59-3053f647e3c2 could not be found. Nov 24 15:29:05.728557 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-24f8c41f-8e4b-4474-b0fe-31919190601a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Returning 404 to user: Instance b89769a5-ef2a-400a-9c59-3053f647e3c2 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:29:05.729383 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-24f8c41f-8e4b-4474-b0fe-31919190601a tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2" status: 404 len: 111 microversion: 2.1 time: 0.030831 Nov 24 15:29:05.733215 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 513/966] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:05 2021] GET /compute/v2.1/servers/b89769a5-ef2a-400a-9c59-3053f647e3c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 15:29:05.836502 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-a51cec55-8ca7-4c60-a6ef-39f46962c3d9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:05.845479 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a51cec55-8ca7-4c60-a6ef-39f46962c3d9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99" status: 200 len: 1317 microversion: 2.1 time: 0.190842 Nov 24 15:29:05.850992 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 454/967] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:05 2021] GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:06.506353 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-4cb77744-3cd5-4177-8450-5f8ea61f052a req-0fb3a9a5-822a-40e7-8187-1e4d8889d3ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "959bf993-a057-4234-92fc-9886b7c6da99", "tag": "da5d7180-031c-4882-8065-eda013b9c740"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:29:06.507867 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:29:06.507867 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:29:06.514659 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-4cb77744-3cd5-4177-8450-5f8ea61f052a req-0fb3a9a5-822a-40e7-8187-1e4d8889d3ed service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:06.515137 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-4cb77744-3cd5-4177-8450-5f8ea61f052a req-0fb3a9a5-822a-40e7-8187-1e4d8889d3ed service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:06.525769 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-4cb77744-3cd5-4177-8450-5f8ea61f052a req-0fb3a9a5-822a-40e7-8187-1e4d8889d3ed service nova] Creating event network-changed:da5d7180-031c-4882-8065-eda013b9c740 for instance 959bf993-a057-4234-92fc-9886b7c6da99 on hv-cinder-80403 Nov 24 15:29:06.530465 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-4cb77744-3cd5-4177-8450-5f8ea61f052a req-0fb3a9a5-822a-40e7-8187-1e4d8889d3ed service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027671 Nov 24 15:29:06.531097 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 514/968] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:29:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:06.862642 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-7ae25458-1ea1-4d97-8f8d-d8f78e2da556 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:06.863652 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-7ae25458-1ea1-4d97-8f8d-d8f78e2da556 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:06.870051 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7ae25458-1ea1-4d97-8f8d-d8f78e2da556 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:06.870496 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7ae25458-1ea1-4d97-8f8d-d8f78e2da556 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:06.871292 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7ae25458-1ea1-4d97-8f8d-d8f78e2da556 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:06.871830 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-7ae25458-1ea1-4d97-8f8d-d8f78e2da556 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:07.018433 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-7ae25458-1ea1-4d97-8f8d-d8f78e2da556 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:07.025718 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-7ae25458-1ea1-4d97-8f8d-d8f78e2da556 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99" status: 200 len: 1317 microversion: 2.1 time: 0.166623 Nov 24 15:29:07.026289 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 455/969] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:06 2021] GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:29:08.045005 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0bfaa93e-2b21-4fe6-b6be-fcf5240b126f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:08.046427 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-0bfaa93e-2b21-4fe6-b6be-fcf5240b126f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:08.052723 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0bfaa93e-2b21-4fe6-b6be-fcf5240b126f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:08.053534 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0bfaa93e-2b21-4fe6-b6be-fcf5240b126f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:08.053945 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0bfaa93e-2b21-4fe6-b6be-fcf5240b126f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:08.054386 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-0bfaa93e-2b21-4fe6-b6be-fcf5240b126f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:08.187068 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-0bfaa93e-2b21-4fe6-b6be-fcf5240b126f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:08.194380 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0bfaa93e-2b21-4fe6-b6be-fcf5240b126f tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99" status: 200 len: 1317 microversion: 2.1 time: 0.153844 Nov 24 15:29:08.194955 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 515/970] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:08 2021] GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:08.811634 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-db6ae480-ae41-429d-826c-9164fa076e71 req-ead9cd28-816d-4a2c-9d18-63dceb47c2ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246791eb-b0eb-44f0-9417-f106580a57f5", "tag": "140a8110-eae9-4c4f-bc1c-8a0a2e8b5413"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:29:08.812432 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-afff2db0-f31f-45c5-9a53-4fd0e67387c0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:08.814343 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:29:08.814343 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:29:08.814607 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-afff2db0-f31f-45c5-9a53-4fd0e67387c0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:08.821254 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-afff2db0-f31f-45c5-9a53-4fd0e67387c0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:08.821703 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-afff2db0-f31f-45c5-9a53-4fd0e67387c0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:08.822559 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-afff2db0-f31f-45c5-9a53-4fd0e67387c0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:08.823033 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-afff2db0-f31f-45c5-9a53-4fd0e67387c0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:08.824954 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-db6ae480-ae41-429d-826c-9164fa076e71 req-ead9cd28-816d-4a2c-9d18-63dceb47c2ae service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:08.825462 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-db6ae480-ae41-429d-826c-9164fa076e71 req-ead9cd28-816d-4a2c-9d18-63dceb47c2ae service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:08.838909 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-db6ae480-ae41-429d-826c-9164fa076e71 req-ead9cd28-816d-4a2c-9d18-63dceb47c2ae service nova] Creating event network-changed:140a8110-eae9-4c4f-bc1c-8a0a2e8b5413 for instance 246791eb-b0eb-44f0-9417-f106580a57f5 on hv-cinder-80403 Nov 24 15:29:08.846020 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-db6ae480-ae41-429d-826c-9164fa076e71 req-ead9cd28-816d-4a2c-9d18-63dceb47c2ae service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037849 Nov 24 15:29:08.847068 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 516/971] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:29:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:08.852552 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-afff2db0-f31f-45c5-9a53-4fd0e67387c0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Going to try to terminate instance {{(pid=116073) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:29:08.939330 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-afff2db0-f31f-45c5-9a53-4fd0e67387c0 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "DELETE /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 204 len: 0 microversion: 2.1 time: 0.135338 Nov 24 15:29:08.940781 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 456/972] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:29:08 2021] DELETE /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 15:29:08.950160 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-764f13c6-af77-4229-bb02-615a380e3ed4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:08.950991 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-764f13c6-af77-4229-bb02-615a380e3ed4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:08.959321 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-764f13c6-af77-4229-bb02-615a380e3ed4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:08.959918 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-764f13c6-af77-4229-bb02-615a380e3ed4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:08.960783 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-764f13c6-af77-4229-bb02-615a380e3ed4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:08.961294 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-764f13c6-af77-4229-bb02-615a380e3ed4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:09.109718 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-764f13c6-af77-4229-bb02-615a380e3ed4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:09.118405 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-764f13c6-af77-4229-bb02-615a380e3ed4 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1578 microversion: 2.1 time: 0.172787 Nov 24 15:29:09.119159 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 517/973] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:08 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1578 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:09.212045 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-189c7c1e-fd4c-4ae8-a410-bfb356620512 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:09.212906 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-189c7c1e-fd4c-4ae8-a410-bfb356620512 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:09.219069 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-189c7c1e-fd4c-4ae8-a410-bfb356620512 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:09.219662 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-189c7c1e-fd4c-4ae8-a410-bfb356620512 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:09.220550 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-189c7c1e-fd4c-4ae8-a410-bfb356620512 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:09.221082 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-189c7c1e-fd4c-4ae8-a410-bfb356620512 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:09.376454 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-189c7c1e-fd4c-4ae8-a410-bfb356620512 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:09.384470 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-189c7c1e-fd4c-4ae8-a410-bfb356620512 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99" status: 200 len: 1317 microversion: 2.1 time: 0.176480 Nov 24 15:29:09.385263 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 457/974] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:09 2021] GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:10.136243 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a9ccba8a-2cef-4414-9354-081b0c49bf31 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:10.136880 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a9ccba8a-2cef-4414-9354-081b0c49bf31 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:10.143816 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9ccba8a-2cef-4414-9354-081b0c49bf31 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:10.144263 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9ccba8a-2cef-4414-9354-081b0c49bf31 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:10.145040 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9ccba8a-2cef-4414-9354-081b0c49bf31 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:10.145472 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a9ccba8a-2cef-4414-9354-081b0c49bf31 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:10.275407 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-a9ccba8a-2cef-4414-9354-081b0c49bf31 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:10.284303 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a9ccba8a-2cef-4414-9354-081b0c49bf31 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1459 microversion: 2.1 time: 0.151736 Nov 24 15:29:10.289309 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 518/975] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:10 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1459 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:10.401346 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a5af91e0-75a6-46a9-8aa0-3d9c9fe56cd2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:10.401871 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a5af91e0-75a6-46a9-8aa0-3d9c9fe56cd2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:10.408306 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a5af91e0-75a6-46a9-8aa0-3d9c9fe56cd2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:10.408968 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a5af91e0-75a6-46a9-8aa0-3d9c9fe56cd2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:10.409756 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a5af91e0-75a6-46a9-8aa0-3d9c9fe56cd2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:10.410195 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a5af91e0-75a6-46a9-8aa0-3d9c9fe56cd2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:10.487013 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-54531264-1797-400f-8471-b7e40e53137d req-533876a1-b25b-455f-9751-2f7534c9590e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959bf993-a057-4234-92fc-9886b7c6da99", "name": "network-vif-plugged", "status": "completed", "tag": "da5d7180-031c-4882-8065-eda013b9c740"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:29:10.488972 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:29:10.488972 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:29:10.496504 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-54531264-1797-400f-8471-b7e40e53137d req-533876a1-b25b-455f-9751-2f7534c9590e service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:10.497087 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-54531264-1797-400f-8471-b7e40e53137d req-533876a1-b25b-455f-9751-2f7534c9590e service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:10.509340 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-54531264-1797-400f-8471-b7e40e53137d req-533876a1-b25b-455f-9751-2f7534c9590e service nova] Creating event network-vif-plugged:da5d7180-031c-4882-8065-eda013b9c740 for instance 959bf993-a057-4234-92fc-9886b7c6da99 on hv-cinder-80403 Nov 24 15:29:10.515282 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-54531264-1797-400f-8471-b7e40e53137d req-533876a1-b25b-455f-9751-2f7534c9590e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031905 Nov 24 15:29:10.516775 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 519/976] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:29:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:10.556542 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-a5af91e0-75a6-46a9-8aa0-3d9c9fe56cd2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:10.565049 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a5af91e0-75a6-46a9-8aa0-3d9c9fe56cd2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99" status: 200 len: 1317 microversion: 2.1 time: 0.167470 Nov 24 15:29:10.569090 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 458/977] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:10 2021] GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:11.175484 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-37a1d484-b54f-475a-b4fe-1cee37003773 req-dbeaa289-e007-48a4-b119-123b3f35169f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246791eb-b0eb-44f0-9417-f106580a57f5", "name": "network-vif-deleted", "tag": "140a8110-eae9-4c4f-bc1c-8a0a2e8b5413"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:29:11.176983 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:29:11.176983 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:29:11.185015 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-37a1d484-b54f-475a-b4fe-1cee37003773 req-dbeaa289-e007-48a4-b119-123b3f35169f service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:11.185455 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-37a1d484-b54f-475a-b4fe-1cee37003773 req-dbeaa289-e007-48a4-b119-123b3f35169f service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:11.195947 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-37a1d484-b54f-475a-b4fe-1cee37003773 req-dbeaa289-e007-48a4-b119-123b3f35169f service nova] Creating event network-vif-deleted:140a8110-eae9-4c4f-bc1c-8a0a2e8b5413 for instance 246791eb-b0eb-44f0-9417-f106580a57f5 on hv-cinder-80403 Nov 24 15:29:11.201037 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-37a1d484-b54f-475a-b4fe-1cee37003773 req-dbeaa289-e007-48a4-b119-123b3f35169f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029908 Nov 24 15:29:11.201671 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 520/978] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:29:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:11.301958 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a3ec49fc-4eff-436d-8554-705e0a8d5d9c tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:11.302570 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a3ec49fc-4eff-436d-8554-705e0a8d5d9c tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:11.308388 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a3ec49fc-4eff-436d-8554-705e0a8d5d9c tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:11.308820 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a3ec49fc-4eff-436d-8554-705e0a8d5d9c tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:11.309599 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a3ec49fc-4eff-436d-8554-705e0a8d5d9c tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:11.310033 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a3ec49fc-4eff-436d-8554-705e0a8d5d9c tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:11.372623 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-a3ec49fc-4eff-436d-8554-705e0a8d5d9c tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad76e9906e5341869af05aace8368403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b981a3c2d7974c7ca0c54a5262ea5220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:11.379902 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a3ec49fc-4eff-436d-8554-705e0a8d5d9c tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 200 len: 1225 microversion: 2.1 time: 0.082261 Nov 24 15:29:11.380506 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 459/979] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:11 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:11.582670 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-77010904-bb33-4fbe-b756-70cc6a5636e4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:11.583435 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-77010904-bb33-4fbe-b756-70cc6a5636e4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:11.589608 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77010904-bb33-4fbe-b756-70cc6a5636e4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:11.590052 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77010904-bb33-4fbe-b756-70cc6a5636e4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:11.591054 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77010904-bb33-4fbe-b756-70cc6a5636e4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:11.591273 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-77010904-bb33-4fbe-b756-70cc6a5636e4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:11.720472 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-77010904-bb33-4fbe-b756-70cc6a5636e4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:11.727643 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-77010904-bb33-4fbe-b756-70cc6a5636e4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99" status: 200 len: 1317 microversion: 2.1 time: 0.149866 Nov 24 15:29:11.728197 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 521/980] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:11 2021] GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:12.396546 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c923b1c9-b308-4cea-9538-fafe6d52f995 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:12.397157 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c923b1c9-b308-4cea-9538-fafe6d52f995 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 246791eb-b0eb-44f0-9417-f106580a57f5] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:12.403425 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c923b1c9-b308-4cea-9538-fafe6d52f995 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:12.403872 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c923b1c9-b308-4cea-9538-fafe6d52f995 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:12.404646 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c923b1c9-b308-4cea-9538-fafe6d52f995 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:12.405078 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c923b1c9-b308-4cea-9538-fafe6d52f995 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:12.418041 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-c923b1c9-b308-4cea-9538-fafe6d52f995 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] HTTP exception thrown: Instance 246791eb-b0eb-44f0-9417-f106580a57f5 could not be found. Nov 24 15:29:12.418613 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c923b1c9-b308-4cea-9538-fafe6d52f995 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Returning 404 to user: Instance 246791eb-b0eb-44f0-9417-f106580a57f5 could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:29:12.419472 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c923b1c9-b308-4cea-9538-fafe6d52f995 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5" status: 404 len: 111 microversion: 2.1 time: 0.026626 Nov 24 15:29:12.419989 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 460/981] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:12 2021] GET /compute/v2.1/servers/246791eb-b0eb-44f0-9417-f106580a57f5 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:29:12.744447 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c884eef7-8ed7-4b04-8b3d-c9d6f036dd26 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:12.745038 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c884eef7-8ed7-4b04-8b3d-c9d6f036dd26 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:12.751441 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c884eef7-8ed7-4b04-8b3d-c9d6f036dd26 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:12.751879 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c884eef7-8ed7-4b04-8b3d-c9d6f036dd26 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:12.752834 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c884eef7-8ed7-4b04-8b3d-c9d6f036dd26 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:12.753267 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c884eef7-8ed7-4b04-8b3d-c9d6f036dd26 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:12.924970 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-275ae49d-d07b-46d7-9fec-9144d4898654 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:12.925462 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-275ae49d-d07b-46d7-9fec-9144d4898654 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:12.931264 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-275ae49d-d07b-46d7-9fec-9144d4898654 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:12.931749 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-275ae49d-d07b-46d7-9fec-9144d4898654 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:12.932516 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-275ae49d-d07b-46d7-9fec-9144d4898654 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:12.932950 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-275ae49d-d07b-46d7-9fec-9144d4898654 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:12.946115 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-275ae49d-d07b-46d7-9fec-9144d4898654 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] HTTP exception thrown: Instance 1a77d835-ce70-43fb-ab67-3b41127405d3 could not be found. Nov 24 15:29:12.946701 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-275ae49d-d07b-46d7-9fec-9144d4898654 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Returning 404 to user: Instance 1a77d835-ce70-43fb-ab67-3b41127405d3 could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:29:12.947549 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-275ae49d-d07b-46d7-9fec-9144d4898654 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 404 len: 111 microversion: 2.1 time: 0.026870 Nov 24 15:29:12.948094 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 461/982] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:29:12 2021] DELETE /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 15:29:12.949903 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-c884eef7-8ed7-4b04-8b3d-c9d6f036dd26 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:12.955758 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-78fb9491-48d1-4a5d-99f9-100d60ae9ae5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:12.956473 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-78fb9491-48d1-4a5d-99f9-100d60ae9ae5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] [instance: 1a77d835-ce70-43fb-ab67-3b41127405d3] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:12.958042 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c884eef7-8ed7-4b04-8b3d-c9d6f036dd26 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99" status: 200 len: 1508 microversion: 2.1 time: 0.217178 Nov 24 15:29:12.958631 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 522/983] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:12 2021] GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99 => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:12.968874 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-78fb9491-48d1-4a5d-99f9-100d60ae9ae5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:12.968874 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-78fb9491-48d1-4a5d-99f9-100d60ae9ae5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:12.968874 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-78fb9491-48d1-4a5d-99f9-100d60ae9ae5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:12.968874 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-78fb9491-48d1-4a5d-99f9-100d60ae9ae5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:12.977987 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-78fb9491-48d1-4a5d-99f9-100d60ae9ae5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] HTTP exception thrown: Instance 1a77d835-ce70-43fb-ab67-3b41127405d3 could not be found. Nov 24 15:29:12.978568 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-78fb9491-48d1-4a5d-99f9-100d60ae9ae5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Returning 404 to user: Instance 1a77d835-ce70-43fb-ab67-3b41127405d3 could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:29:12.979420 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-78fb9491-48d1-4a5d-99f9-100d60ae9ae5 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3" status: 404 len: 111 microversion: 2.1 time: 0.027242 Nov 24 15:29:12.979958 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 462/984] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:12 2021] GET /compute/v2.1/servers/1a77d835-ce70-43fb-ab67-3b41127405d3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 15:29:14.258215 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5b80749a-8a48-4010-860a-1985b3c71071 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] Calling method '.version_select at 0x7f930caf8a60>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:14.277111 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-165ebe0b-c729-43ec-982f-5d4617fa53db tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15adb3f5-9817-4c68-a94f-52df9a725bd3"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:29:14.278690 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-165ebe0b-c729-43ec-982f-5d4617fa53db tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:14.285970 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-165ebe0b-c729-43ec-982f-5d4617fa53db tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:14.286437 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-165ebe0b-c729-43ec-982f-5d4617fa53db tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:14.287259 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-165ebe0b-c729-43ec-982f-5d4617fa53db tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:14.287946 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-165ebe0b-c729-43ec-982f-5d4617fa53db tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:14.290715 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5b80749a-8a48-4010-860a-1985b3c71071 tempest-TestVolumeBootPattern-2041955855 tempest-TestVolumeBootPattern-2041955855-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1044302524" status: 202 len: 0 microversion: 2.1 time: 0.036062 Nov 24 15:29:14.291993 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 523/985] 10.222.0.66 () {58 vars in 1262 bytes} [Wed Nov 24 15:29:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1044302524 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 24 15:29:14.524782 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-165ebe0b-c729-43ec-982f-5d4617fa53db tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "POST /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251250 Nov 24 15:29:14.525554 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 463/986] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Nov 24 15:29:14 2021] POST /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:21.077544 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6c002625-d9f4-4c8a-9754-335a39b17eb9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:21.078222 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6c002625-d9f4-4c8a-9754-335a39b17eb9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:21.083852 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6c002625-d9f4-4c8a-9754-335a39b17eb9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:21.084302 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6c002625-d9f4-4c8a-9754-335a39b17eb9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:21.085085 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6c002625-d9f4-4c8a-9754-335a39b17eb9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:21.085524 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6c002625-d9f4-4c8a-9754-335a39b17eb9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:21.166533 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-6c002625-d9f4-4c8a-9754-335a39b17eb9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lazy-loading 'services' on Instance uuid 959bf993-a057-4234-92fc-9886b7c6da99 {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:29:21.237272 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6c002625-d9f4-4c8a-9754-335a39b17eb9 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "DELETE /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99/os-volume_attachments/15adb3f5-9817-4c68-a94f-52df9a725bd3" status: 202 len: 0 microversion: 2.1 time: 0.163691 Nov 24 15:29:21.238407 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 524/987] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Nov 24 15:29:21 2021] DELETE /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99/os-volume_attachments/15adb3f5-9817-4c68-a94f-52df9a725bd3 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:29:21.247809 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a0f5d575-04c3-4b30-8671-6596b1b59e1d tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:21.249655 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a0f5d575-04c3-4b30-8671-6596b1b59e1d tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:21.256562 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a0f5d575-04c3-4b30-8671-6596b1b59e1d tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:21.256941 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a0f5d575-04c3-4b30-8671-6596b1b59e1d tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:21.257950 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a0f5d575-04c3-4b30-8671-6596b1b59e1d tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:21.263801 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a0f5d575-04c3-4b30-8671-6596b1b59e1d tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:21.298520 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a0f5d575-04c3-4b30-8671-6596b1b59e1d tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055245 Nov 24 15:29:21.302404 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 464/988] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:29:21 2021] GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:29:22.310448 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6dc0a113-d00a-427b-abfd-4a380e3463dd tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:22.311562 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6dc0a113-d00a-427b-abfd-4a380e3463dd tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:22.318384 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6dc0a113-d00a-427b-abfd-4a380e3463dd tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:22.318853 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6dc0a113-d00a-427b-abfd-4a380e3463dd tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:22.319627 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6dc0a113-d00a-427b-abfd-4a380e3463dd tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:22.320057 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6dc0a113-d00a-427b-abfd-4a380e3463dd tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:22.347783 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6dc0a113-d00a-427b-abfd-4a380e3463dd tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041955 Nov 24 15:29:22.348333 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 525/989] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:29:22 2021] GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:29:23.522260 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-dd36336a-89cd-4185-9db0-51960624335c tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:23.522756 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-dd36336a-89cd-4185-9db0-51960624335c tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:23.529314 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dd36336a-89cd-4185-9db0-51960624335c tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:23.529761 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dd36336a-89cd-4185-9db0-51960624335c tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:23.530533 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dd36336a-89cd-4185-9db0-51960624335c tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:23.530999 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-dd36336a-89cd-4185-9db0-51960624335c tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:23.555269 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-dd36336a-89cd-4185-9db0-51960624335c tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Going to try to terminate instance {{(pid=116073) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:29:23.627273 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-dd36336a-89cd-4185-9db0-51960624335c tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "DELETE /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99" status: 204 len: 0 microversion: 2.1 time: 0.108258 Nov 24 15:29:23.627855 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 465/990] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:29:23 2021] DELETE /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:29:23.636151 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-aafe4ecf-d64e-4e9c-8079-5678eb500bf8 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:23.636866 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-aafe4ecf-d64e-4e9c-8079-5678eb500bf8 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:23.642819 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aafe4ecf-d64e-4e9c-8079-5678eb500bf8 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:23.643303 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aafe4ecf-d64e-4e9c-8079-5678eb500bf8 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:23.644145 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aafe4ecf-d64e-4e9c-8079-5678eb500bf8 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:23.644578 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-aafe4ecf-d64e-4e9c-8079-5678eb500bf8 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:23.774978 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-aafe4ecf-d64e-4e9c-8079-5678eb500bf8 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:23.782165 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-aafe4ecf-d64e-4e9c-8079-5678eb500bf8 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99" status: 200 len: 1514 microversion: 2.1 time: 0.149742 Nov 24 15:29:23.782737 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 526/991] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:23 2021] GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:29:24.799552 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-360fa073-832c-47a6-94ba-639bfdbd90f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:24.800243 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-360fa073-832c-47a6-94ba-639bfdbd90f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:24.806715 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-360fa073-832c-47a6-94ba-639bfdbd90f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:24.807220 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-360fa073-832c-47a6-94ba-639bfdbd90f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:24.807986 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-360fa073-832c-47a6-94ba-639bfdbd90f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:24.808643 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-360fa073-832c-47a6-94ba-639bfdbd90f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:24.940260 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-360fa073-832c-47a6-94ba-639bfdbd90f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:24.949173 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-360fa073-832c-47a6-94ba-639bfdbd90f5 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99" status: 200 len: 1514 microversion: 2.1 time: 0.153471 Nov 24 15:29:24.949823 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 466/992] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:24 2021] GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:25.777851 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-1f87e903-2602-4cdd-bf29-dc8423899b54 req-84ca07a1-42e6-41c9-bc74-5efc5ced1080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "959bf993-a057-4234-92fc-9886b7c6da99", "name": "network-vif-deleted", "tag": "da5d7180-031c-4882-8065-eda013b9c740"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:29:25.779794 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:29:25.779794 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:29:25.789852 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1f87e903-2602-4cdd-bf29-dc8423899b54 req-84ca07a1-42e6-41c9-bc74-5efc5ced1080 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:25.790288 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-1f87e903-2602-4cdd-bf29-dc8423899b54 req-84ca07a1-42e6-41c9-bc74-5efc5ced1080 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:25.805117 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-1f87e903-2602-4cdd-bf29-dc8423899b54 req-84ca07a1-42e6-41c9-bc74-5efc5ced1080 service nova] Creating event network-vif-deleted:da5d7180-031c-4882-8065-eda013b9c740 for instance 959bf993-a057-4234-92fc-9886b7c6da99 on hv-cinder-80403 Nov 24 15:29:25.811627 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-1f87e903-2602-4cdd-bf29-dc8423899b54 req-84ca07a1-42e6-41c9-bc74-5efc5ced1080 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038164 Nov 24 15:29:25.812691 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 527/993] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:29:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:25.974006 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-307c1801-79f5-401a-8156-2605a34017bf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:25.975363 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-307c1801-79f5-401a-8156-2605a34017bf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:25.981911 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-307c1801-79f5-401a-8156-2605a34017bf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:25.982361 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-307c1801-79f5-401a-8156-2605a34017bf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:25.983468 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-307c1801-79f5-401a-8156-2605a34017bf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:25.983905 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-307c1801-79f5-401a-8156-2605a34017bf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:26.016289 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-307c1801-79f5-401a-8156-2605a34017bf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:26.016736 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-307c1801-79f5-401a-8156-2605a34017bf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:26.017184 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-307c1801-79f5-401a-8156-2605a34017bf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lazy-loading 'fault' on Instance uuid 959bf993-a057-4234-92fc-9886b7c6da99 {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:29:26.056246 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-307c1801-79f5-401a-8156-2605a34017bf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:26.063681 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-307c1801-79f5-401a-8156-2605a34017bf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99" status: 200 len: 1307 microversion: 2.1 time: 0.099886 Nov 24 15:29:26.064257 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 467/994] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:25 2021] GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99 => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:27.081508 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1cbfdcd6-0d31-4682-9233-c57ac5ba4747 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:27.082196 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-1cbfdcd6-0d31-4682-9233-c57ac5ba4747 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: 959bf993-a057-4234-92fc-9886b7c6da99] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:27.088601 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1cbfdcd6-0d31-4682-9233-c57ac5ba4747 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:27.089043 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1cbfdcd6-0d31-4682-9233-c57ac5ba4747 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:27.089929 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1cbfdcd6-0d31-4682-9233-c57ac5ba4747 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:27.090413 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-1cbfdcd6-0d31-4682-9233-c57ac5ba4747 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:27.102955 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-1cbfdcd6-0d31-4682-9233-c57ac5ba4747 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] HTTP exception thrown: Instance 959bf993-a057-4234-92fc-9886b7c6da99 could not be found. Nov 24 15:29:27.103525 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-1cbfdcd6-0d31-4682-9233-c57ac5ba4747 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Returning 404 to user: Instance 959bf993-a057-4234-92fc-9886b7c6da99 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:29:27.104316 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-1cbfdcd6-0d31-4682-9233-c57ac5ba4747 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99" status: 404 len: 111 microversion: 2.1 time: 0.027481 Nov 24 15:29:27.104828 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 528/995] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:27 2021] GET /compute/v2.1/servers/959bf993-a057-4234-92fc-9886b7c6da99 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:29:28.231609 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-a8fbcd4e-e97d-42b8-a7e8-e743714072a4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:28.232117 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a8fbcd4e-e97d-42b8-a7e8-e743714072a4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:28.238932 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a8fbcd4e-e97d-42b8-a7e8-e743714072a4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:28.239378 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a8fbcd4e-e97d-42b8-a7e8-e743714072a4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:28.240143 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a8fbcd4e-e97d-42b8-a7e8-e743714072a4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:28.240569 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-a8fbcd4e-e97d-42b8-a7e8-e743714072a4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:28.264934 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-a8fbcd4e-e97d-42b8-a7e8-e743714072a4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Going to try to terminate instance {{(pid=116073) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:29:28.339371 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-a8fbcd4e-e97d-42b8-a7e8-e743714072a4 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b" status: 204 len: 0 microversion: 2.1 time: 0.111103 Nov 24 15:29:28.340153 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 468/996] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:29:28 2021] DELETE /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 24 15:29:28.348429 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9bf0d96f-ca2a-49b9-9c30-85fc09bebbaf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:28.349087 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9bf0d96f-ca2a-49b9-9c30-85fc09bebbaf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:28.355253 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9bf0d96f-ca2a-49b9-9c30-85fc09bebbaf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:28.355701 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9bf0d96f-ca2a-49b9-9c30-85fc09bebbaf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:28.356475 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9bf0d96f-ca2a-49b9-9c30-85fc09bebbaf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:28.356907 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9bf0d96f-ca2a-49b9-9c30-85fc09bebbaf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:28.680053 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-9bf0d96f-ca2a-49b9-9c30-85fc09bebbaf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:28.687805 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9bf0d96f-ca2a-49b9-9c30-85fc09bebbaf tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b" status: 200 len: 1513 microversion: 2.1 time: 0.342952 Nov 24 15:29:28.688365 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 529/997] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:28 2021] GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b => generated 1513 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:29.705222 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-79bca988-89c7-41f4-bcd0-eb317a13895a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:29.705840 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-79bca988-89c7-41f4-bcd0-eb317a13895a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:29.712142 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-79bca988-89c7-41f4-bcd0-eb317a13895a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:29.712594 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-79bca988-89c7-41f4-bcd0-eb317a13895a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:29.713374 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-79bca988-89c7-41f4-bcd0-eb317a13895a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:29.713810 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-79bca988-89c7-41f4-bcd0-eb317a13895a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:29.898758 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-79bca988-89c7-41f4-bcd0-eb317a13895a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:29.906583 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-79bca988-89c7-41f4-bcd0-eb317a13895a tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b" status: 200 len: 1513 microversion: 2.1 time: 0.204936 Nov 24 15:29:29.907184 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 469/998] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:29 2021] GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:30.373080 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-ee7a58f9-4b00-4c0a-8d35-86e920b4cc6f req-fc6e825f-8c72-432a-a2e9-c73b1acd33f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e64a4011-c8a2-4021-bbb2-ef5886c1c12b", "name": "network-vif-deleted", "tag": "50d1a0ec-16c2-441e-8145-73d64751ca07"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:29:30.375193 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:29:30.375193 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:29:30.385954 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-ee7a58f9-4b00-4c0a-8d35-86e920b4cc6f req-fc6e825f-8c72-432a-a2e9-c73b1acd33f4 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:30.386772 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-ee7a58f9-4b00-4c0a-8d35-86e920b4cc6f req-fc6e825f-8c72-432a-a2e9-c73b1acd33f4 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:30.399455 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-ee7a58f9-4b00-4c0a-8d35-86e920b4cc6f req-fc6e825f-8c72-432a-a2e9-c73b1acd33f4 service nova] Creating event network-vif-deleted:50d1a0ec-16c2-441e-8145-73d64751ca07 for instance e64a4011-c8a2-4021-bbb2-ef5886c1c12b on hv-cinder-80403 Nov 24 15:29:30.406645 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-ee7a58f9-4b00-4c0a-8d35-86e920b4cc6f req-fc6e825f-8c72-432a-a2e9-c73b1acd33f4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037677 Nov 24 15:29:30.407286 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 530/999] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:29:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:30.923532 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-78724282-d20a-42cb-a36e-7fe3b1f41c43 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:30.924138 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-78724282-d20a-42cb-a36e-7fe3b1f41c43 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e64a4011-c8a2-4021-bbb2-ef5886c1c12b] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:30.930595 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-78724282-d20a-42cb-a36e-7fe3b1f41c43 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:30.931082 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-78724282-d20a-42cb-a36e-7fe3b1f41c43 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:30.931854 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-78724282-d20a-42cb-a36e-7fe3b1f41c43 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:30.932318 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-78724282-d20a-42cb-a36e-7fe3b1f41c43 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:30.945423 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-78724282-d20a-42cb-a36e-7fe3b1f41c43 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] HTTP exception thrown: Instance e64a4011-c8a2-4021-bbb2-ef5886c1c12b could not be found. Nov 24 15:29:30.946002 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-78724282-d20a-42cb-a36e-7fe3b1f41c43 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Returning 404 to user: Instance e64a4011-c8a2-4021-bbb2-ef5886c1c12b could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:29:30.946824 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-78724282-d20a-42cb-a36e-7fe3b1f41c43 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b" status: 404 len: 111 microversion: 2.1 time: 0.027541 Nov 24 15:29:30.947371 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 470/1000] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:30 2021] GET /compute/v2.1/servers/e64a4011-c8a2-4021-bbb2-ef5886c1c12b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 24 15:29:30.955800 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-42e5848c-6506-497b-8014-4c0a1da7f6c0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:30.956564 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-42e5848c-6506-497b-8014-4c0a1da7f6c0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:30.963809 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42e5848c-6506-497b-8014-4c0a1da7f6c0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:30.964256 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42e5848c-6506-497b-8014-4c0a1da7f6c0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:30.965040 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42e5848c-6506-497b-8014-4c0a1da7f6c0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:30.965471 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-42e5848c-6506-497b-8014-4c0a1da7f6c0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:30.991852 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-42e5848c-6506-497b-8014-4c0a1da7f6c0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:29:31.066926 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-42e5848c-6506-497b-8014-4c0a1da7f6c0 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0" status: 204 len: 0 microversion: 2.1 time: 0.114847 Nov 24 15:29:31.067517 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 531/1001] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:29:30 2021] DELETE /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:29:31.075245 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-47b7bf7c-28cc-4139-a069-7eb1cff257af tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:31.075844 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-47b7bf7c-28cc-4139-a069-7eb1cff257af tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:31.082187 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-47b7bf7c-28cc-4139-a069-7eb1cff257af tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:31.082633 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-47b7bf7c-28cc-4139-a069-7eb1cff257af tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:31.083434 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-47b7bf7c-28cc-4139-a069-7eb1cff257af tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:31.083866 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-47b7bf7c-28cc-4139-a069-7eb1cff257af tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:31.210620 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-47b7bf7c-28cc-4139-a069-7eb1cff257af tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:31.218092 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-47b7bf7c-28cc-4139-a069-7eb1cff257af tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0" status: 200 len: 1514 microversion: 2.1 time: 0.146490 Nov 24 15:29:31.219379 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 471/1002] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:31 2021] GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:32.236691 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-96bbac12-10fb-4029-9a95-80849db3670e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:32.237415 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-96bbac12-10fb-4029-9a95-80849db3670e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:32.243959 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-96bbac12-10fb-4029-9a95-80849db3670e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:32.244416 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-96bbac12-10fb-4029-9a95-80849db3670e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:32.245194 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-96bbac12-10fb-4029-9a95-80849db3670e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:32.245660 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-96bbac12-10fb-4029-9a95-80849db3670e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:32.377572 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-96bbac12-10fb-4029-9a95-80849db3670e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:32.384970 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-96bbac12-10fb-4029-9a95-80849db3670e tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0" status: 200 len: 1514 microversion: 2.1 time: 0.152281 Nov 24 15:29:32.385546 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 532/1003] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:32 2021] GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:32.818584 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-3464d357-3d93-4e09-ab4d-da42d3053acd req-08cbcb13-dda5-4ccb-8308-1b6d2e9ab6dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7550ec0-8dc1-4be7-aa6c-0747730a0ef0", "name": "network-vif-deleted", "tag": "7fc3bdcc-ac1d-4a0d-b4a6-b9a0d99f789e"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:29:32.820152 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:29:32.820152 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:29:32.827402 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-3464d357-3d93-4e09-ab4d-da42d3053acd req-08cbcb13-dda5-4ccb-8308-1b6d2e9ab6dd service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:32.828433 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-3464d357-3d93-4e09-ab4d-da42d3053acd req-08cbcb13-dda5-4ccb-8308-1b6d2e9ab6dd service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:32.840374 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-3464d357-3d93-4e09-ab4d-da42d3053acd req-08cbcb13-dda5-4ccb-8308-1b6d2e9ab6dd service nova] Creating event network-vif-deleted:7fc3bdcc-ac1d-4a0d-b4a6-b9a0d99f789e for instance e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 on hv-cinder-80403 Nov 24 15:29:32.847148 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-3464d357-3d93-4e09-ab4d-da42d3053acd req-08cbcb13-dda5-4ccb-8308-1b6d2e9ab6dd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032014 Nov 24 15:29:32.847789 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 472/1004] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:29:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:33.401713 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-acb0acd9-f817-4c9e-967f-09e3d89c1350 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:33.402317 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-acb0acd9-f817-4c9e-967f-09e3d89c1350 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: e7550ec0-8dc1-4be7-aa6c-0747730a0ef0] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:33.408767 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-acb0acd9-f817-4c9e-967f-09e3d89c1350 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:33.409162 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-acb0acd9-f817-4c9e-967f-09e3d89c1350 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:33.409937 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-acb0acd9-f817-4c9e-967f-09e3d89c1350 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:33.410372 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-acb0acd9-f817-4c9e-967f-09e3d89c1350 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:33.423668 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-acb0acd9-f817-4c9e-967f-09e3d89c1350 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] HTTP exception thrown: Instance e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 could not be found. Nov 24 15:29:33.424270 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-acb0acd9-f817-4c9e-967f-09e3d89c1350 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Returning 404 to user: Instance e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:29:33.425067 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-acb0acd9-f817-4c9e-967f-09e3d89c1350 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0" status: 404 len: 111 microversion: 2.1 time: 0.027065 Nov 24 15:29:33.425588 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 533/1005] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:33 2021] GET /compute/v2.1/servers/e7550ec0-8dc1-4be7-aa6c-0747730a0ef0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:29:34.551190 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-3638486b-b6d2-4377-b1ba-67ecef21fdcc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:34.551767 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3638486b-b6d2-4377-b1ba-67ecef21fdcc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:34.557762 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3638486b-b6d2-4377-b1ba-67ecef21fdcc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:34.558207 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3638486b-b6d2-4377-b1ba-67ecef21fdcc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:34.559026 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3638486b-b6d2-4377-b1ba-67ecef21fdcc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:34.559453 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-3638486b-b6d2-4377-b1ba-67ecef21fdcc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:34.584773 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-3638486b-b6d2-4377-b1ba-67ecef21fdcc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Going to try to terminate instance {{(pid=116073) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:29:34.657078 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-3638486b-b6d2-4377-b1ba-67ecef21fdcc tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132" status: 204 len: 0 microversion: 2.1 time: 0.110131 Nov 24 15:29:34.657747 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 473/1006] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:29:34 2021] DELETE /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:29:34.665702 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6a6eea55-7c07-4d6e-bbc2-8d4eceb73446 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:34.666306 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6a6eea55-7c07-4d6e-bbc2-8d4eceb73446 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:34.672573 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a6eea55-7c07-4d6e-bbc2-8d4eceb73446 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:34.673084 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a6eea55-7c07-4d6e-bbc2-8d4eceb73446 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:34.673871 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a6eea55-7c07-4d6e-bbc2-8d4eceb73446 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:34.674302 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a6eea55-7c07-4d6e-bbc2-8d4eceb73446 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:34.807415 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6a6eea55-7c07-4d6e-bbc2-8d4eceb73446 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:34.815410 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6a6eea55-7c07-4d6e-bbc2-8d4eceb73446 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132" status: 200 len: 1514 microversion: 2.1 time: 0.153471 Nov 24 15:29:34.815964 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 534/1007] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:34 2021] GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:35.833225 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2bc341e9-053c-469e-940d-67d08cb46ab2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:35.833917 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2bc341e9-053c-469e-940d-67d08cb46ab2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:35.840169 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2bc341e9-053c-469e-940d-67d08cb46ab2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:35.840615 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2bc341e9-053c-469e-940d-67d08cb46ab2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:35.841385 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2bc341e9-053c-469e-940d-67d08cb46ab2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:35.841814 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2bc341e9-053c-469e-940d-67d08cb46ab2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:35.973219 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-2bc341e9-053c-469e-940d-67d08cb46ab2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:35.980676 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2bc341e9-053c-469e-940d-67d08cb46ab2 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132" status: 200 len: 1514 microversion: 2.1 time: 0.151515 Nov 24 15:29:35.981247 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 474/1008] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:35 2021] GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:36.623156 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-9e3c26ce-29fb-47be-905a-20cb49859972 req-2d10e744-bf45-47ff-897c-a29bb8b9a093 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef9112ee-7671-4710-858e-fd623de49132", "name": "network-vif-deleted", "tag": "92eec736-e4cd-4ccf-be5a-8014d692c990"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:29:36.625427 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:29:36.625427 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:29:36.635988 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-9e3c26ce-29fb-47be-905a-20cb49859972 req-2d10e744-bf45-47ff-897c-a29bb8b9a093 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:36.636432 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-9e3c26ce-29fb-47be-905a-20cb49859972 req-2d10e744-bf45-47ff-897c-a29bb8b9a093 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:36.648649 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-9e3c26ce-29fb-47be-905a-20cb49859972 req-2d10e744-bf45-47ff-897c-a29bb8b9a093 service nova] Creating event network-vif-deleted:92eec736-e4cd-4ccf-be5a-8014d692c990 for instance ef9112ee-7671-4710-858e-fd623de49132 on hv-cinder-80403 Nov 24 15:29:36.653480 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-9e3c26ce-29fb-47be-905a-20cb49859972 req-2d10e744-bf45-47ff-897c-a29bb8b9a093 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034355 Nov 24 15:29:36.654058 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 535/1009] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:29:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:36.997149 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-67fe2f52-5b05-430c-9685-254936d60348 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:36.997792 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-67fe2f52-5b05-430c-9685-254936d60348 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:37.004184 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-67fe2f52-5b05-430c-9685-254936d60348 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:37.004634 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-67fe2f52-5b05-430c-9685-254936d60348 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:37.005422 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-67fe2f52-5b05-430c-9685-254936d60348 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:37.006085 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-67fe2f52-5b05-430c-9685-254936d60348 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:37.037725 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-67fe2f52-5b05-430c-9685-254936d60348 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:37.038248 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-67fe2f52-5b05-430c-9685-254936d60348 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:37.038703 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-67fe2f52-5b05-430c-9685-254936d60348 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lazy-loading 'fault' on Instance uuid ef9112ee-7671-4710-858e-fd623de49132 {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:29:37.083074 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-67fe2f52-5b05-430c-9685-254936d60348 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac9a46bfbc60461db2ab14f473c9a80e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '334c8b40c125486ba3a4da48c4908263', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:29:37.089861 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-67fe2f52-5b05-430c-9685-254936d60348 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132" status: 200 len: 1307 microversion: 2.1 time: 0.096329 Nov 24 15:29:37.090434 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 475/1010] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:36 2021] GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:38.107772 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9054c6a8-6e0d-428d-81f2-b13d9129aa78 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:38.108465 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-9054c6a8-6e0d-428d-81f2-b13d9129aa78 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] [instance: ef9112ee-7671-4710-858e-fd623de49132] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:29:38.114754 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9054c6a8-6e0d-428d-81f2-b13d9129aa78 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:38.115229 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9054c6a8-6e0d-428d-81f2-b13d9129aa78 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:38.116026 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9054c6a8-6e0d-428d-81f2-b13d9129aa78 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:29:38.116461 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-9054c6a8-6e0d-428d-81f2-b13d9129aa78 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:29:38.129754 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-9054c6a8-6e0d-428d-81f2-b13d9129aa78 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] HTTP exception thrown: Instance ef9112ee-7671-4710-858e-fd623de49132 could not be found. Nov 24 15:29:38.130330 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-9054c6a8-6e0d-428d-81f2-b13d9129aa78 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] Returning 404 to user: Instance ef9112ee-7671-4710-858e-fd623de49132 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:29:38.131165 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-9054c6a8-6e0d-428d-81f2-b13d9129aa78 tempest-AttachVolumeNegativeTest-1852200851 tempest-AttachVolumeNegativeTest-1852200851-project] 10.222.0.66 "GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132" status: 404 len: 111 microversion: 2.1 time: 0.027962 Nov 24 15:29:38.131690 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 536/1011] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:29:38 2021] GET /compute/v2.1/servers/ef9112ee-7671-4710-858e-fd623de49132 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:29:41.016210 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-02f69682-da42-486c-bf4c-23de2ade56c7 tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] Calling method '.version_select at 0x7f930d4d0940>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:41.061339 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-02f69682-da42-486c-bf4c-23de2ade56c7 tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/912116fd-3ffd-40db-a2f0-45b82972c209" status: 200 len: 350 microversion: 2.1 time: 0.048595 Nov 24 15:29:41.061904 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 476/1012] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:29:41 2021] GET /compute/v2.1/os-volumes/912116fd-3ffd-40db-a2f0-45b82972c209 => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:42.359895 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ffc9841d-f4d5-41f4-996f-7684c94d550e tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] Calling method '.version_select at 0x7f930cc16790>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:42.405031 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ffc9841d-f4d5-41f4-996f-7684c94d550e tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/7efca0c9-b362-4061-beb0-90c1f022532d" status: 200 len: 350 microversion: 2.1 time: 0.049173 Nov 24 15:29:42.405592 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 537/1013] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:29:42 2021] GET /compute/v2.1/os-volumes/7efca0c9-b362-4061-beb0-90c1f022532d => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:43.721018 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b79e9ec9-aad4-4c9b-8cd5-d82dcfa9d6f5 tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] Calling method '.version_select at 0x7f930cb45af0>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:43.765643 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b79e9ec9-aad4-4c9b-8cd5-d82dcfa9d6f5 tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e7381243-7612-4f8c-a52c-5315e84424bf" status: 200 len: 350 microversion: 2.1 time: 0.048660 Nov 24 15:29:43.766230 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 477/1014] 10.222.0.66 () {58 vars in 1244 bytes} [Wed Nov 24 15:29:43 2021] GET /compute/v2.1/os-volumes/e7381243-7612-4f8c-a52c-5315e84424bf => generated 350 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:43.777525 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4bb9c781-3c4c-4f5c-a80d-07b8ac4ee69e tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] Calling method '.version_select at 0x7f930cab3ca0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:43.856171 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4bb9c781-3c4c-4f5c-a80d-07b8ac4ee69e tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.082824 Nov 24 15:29:43.856736 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 538/1015] 10.222.0.66 () {58 vars in 1133 bytes} [Wed Nov 24 15:29:43 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:43.869053 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-ae02d7d6-a537-4975-9b91-0b8e772014ef tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] Calling method '.version_select at 0x7f930cbf2310>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:43.949836 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-ae02d7d6-a537-4975-9b91-0b8e772014ef tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.084229 Nov 24 15:29:43.950397 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 478/1016] 10.222.0.66 () {58 vars in 1148 bytes} [Wed Nov 24 15:29:43 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:43.961857 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d7ef65a8-4fad-40cb-80e6-e3d2012b3ba9 tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] Calling method '.version_select at 0x7f930cbbeaf0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:44.040741 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d7ef65a8-4fad-40cb-80e6-e3d2012b3ba9 tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.082330 Nov 24 15:29:44.041304 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 539/1017] 10.222.0.66 () {58 vars in 1133 bytes} [Wed Nov 24 15:29:43 2021] GET /compute/v2.1/os-volumes => generated 1033 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:44.052526 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-535beaa7-7b9d-4751-9695-85b7805a64ff tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] Calling method '.version_select at 0x7f930cbaa310>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:44.130934 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-535beaa7-7b9d-4751-9695-85b7805a64ff tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.081840 Nov 24 15:29:44.131501 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 479/1018] 10.222.0.66 () {58 vars in 1166 bytes} [Wed Nov 24 15:29:44 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:44.142639 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-849edbfd-ef05-40ab-8989-51aa51a4edbb tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] Calling method '.version_select at 0x7f930cbe3430>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:44.219455 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-849edbfd-ef05-40ab-8989-51aa51a4edbb tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.079754 Nov 24 15:29:44.220143 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 540/1019] 10.222.0.66 () {58 vars in 1169 bytes} [Wed Nov 24 15:29:44 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:44.231596 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-1b6009db-bbaa-42dc-ae58-136d241cbfee tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] Calling method '.version_select at 0x7f930d6121f0>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:44.310367 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-1b6009db-bbaa-42dc-ae58-136d241cbfee tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.082229 Nov 24 15:29:44.310967 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 480/1020] 10.222.0.66 () {58 vars in 1154 bytes} [Wed Nov 24 15:29:44 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:29:44.322130 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-5f1e37ce-7191-4f4c-96dc-254a074e1d0b tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] Calling method '.version_select at 0x7f930cb675e0>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:44.407536 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-5f1e37ce-7191-4f4c-96dc-254a074e1d0b tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088813 Nov 24 15:29:44.408161 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 541/1021] 10.222.0.66 () {58 vars in 1187 bytes} [Wed Nov 24 15:29:44 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:29:44.419459 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8e348e11-17c2-49f7-91e7-9154f59dbea1 tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] Calling method '.version_select at 0x7f930cb7f040>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:29:44.501691 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8e348e11-17c2-49f7-91e7-9154f59dbea1 tempest-VolumesTestJSON-1712216984 tempest-VolumesTestJSON-1712216984-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.085727 Nov 24 15:29:44.502260 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 481/1022] 10.222.0.66 () {58 vars in 1154 bytes} [Wed Nov 24 15:29:44 2021] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:03.143108 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-729731873", "imageRef": "b00e4eee-f8bd-409f-aeac-52f5956632db", "flavorRef": "452"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:30:03.191889 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] validate_networks() for None {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:30:03.460256 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:30:03.460679 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:30:03.461181 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:30:03.461609 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:30:03.462003 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:30:03.470672 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:03.471162 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:03.471966 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:03.472404 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:03.488488 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Getting quotas for project 4290cbbab53745588528c99ae7f72032. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:30:03.492615 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Getting quotas for user 114a8c8cc0f74800b9502dded7e87f64 and project 4290cbbab53745588528c99ae7f72032. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:30:03.503517 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:30:03.505765 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] [instance: 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b00e4eee-f8bd-409f-aeac-52f5956632db',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:30:03.549810 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f9f58134-9159-4422-9096-38cf29a34836 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.411301 Nov 24 15:30:03.550446 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 542/1023] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:30:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:30:03.560623 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b8341a5d-5f6f-4f5f-87b1-d2f6b79ee3b5 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:03.561325 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b8341a5d-5f6f-4f5f-87b1-d2f6b79ee3b5 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] [instance: 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:03.612968 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-b8341a5d-5f6f-4f5f-87b1-d2f6b79ee3b5 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114a8c8cc0f74800b9502dded7e87f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290cbbab53745588528c99ae7f72032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:03.619604 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b8341a5d-5f6f-4f5f-87b1-d2f6b79ee3b5 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] 10.222.0.66 "GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41" status: 200 len: 1214 microversion: 2.1 time: 0.062983 Nov 24 15:30:03.620196 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 482/1024] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:03 2021] GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 => generated 1214 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:04.637608 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e17b49b7-babb-4f7b-8cbf-3f33a93b19c4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:04.638301 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e17b49b7-babb-4f7b-8cbf-3f33a93b19c4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] [instance: 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:04.646018 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e17b49b7-babb-4f7b-8cbf-3f33a93b19c4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:04.646477 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e17b49b7-babb-4f7b-8cbf-3f33a93b19c4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:04.647293 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e17b49b7-babb-4f7b-8cbf-3f33a93b19c4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:04.648326 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e17b49b7-babb-4f7b-8cbf-3f33a93b19c4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:04.711246 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e17b49b7-babb-4f7b-8cbf-3f33a93b19c4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114a8c8cc0f74800b9502dded7e87f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290cbbab53745588528c99ae7f72032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:04.718999 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e17b49b7-babb-4f7b-8cbf-3f33a93b19c4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] 10.222.0.66 "GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41" status: 200 len: 1272 microversion: 2.1 time: 0.085932 Nov 24 15:30:04.719559 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 543/1025] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:04 2021] GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:05.736716 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-d17e7358-b6dd-4a00-926f-37a328fcfc80 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:05.738214 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-d17e7358-b6dd-4a00-926f-37a328fcfc80 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] [instance: 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:05.745132 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d17e7358-b6dd-4a00-926f-37a328fcfc80 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:05.745588 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d17e7358-b6dd-4a00-926f-37a328fcfc80 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:05.746370 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d17e7358-b6dd-4a00-926f-37a328fcfc80 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:05.746959 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-d17e7358-b6dd-4a00-926f-37a328fcfc80 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:05.876031 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-d17e7358-b6dd-4a00-926f-37a328fcfc80 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114a8c8cc0f74800b9502dded7e87f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290cbbab53745588528c99ae7f72032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:05.886936 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-d17e7358-b6dd-4a00-926f-37a328fcfc80 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] 10.222.0.66 "GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41" status: 200 len: 1314 microversion: 2.1 time: 0.154540 Nov 24 15:30:05.888220 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 483/1026] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:05 2021] GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:06.104325 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-af066d57-4123-44f0-a66e-c564acf60ec1 req-6526d3ff-4e7f-40f8-aac1-8bc96cbfe348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bf02c45-aa44-4c3d-810f-49ee2ab6ad41", "tag": "02ba6f53-1c39-4dad-8765-31b24cf07fde"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:30:06.106824 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:30:06.106824 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:30:06.127453 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-af066d57-4123-44f0-a66e-c564acf60ec1 req-6526d3ff-4e7f-40f8-aac1-8bc96cbfe348 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:06.127903 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-af066d57-4123-44f0-a66e-c564acf60ec1 req-6526d3ff-4e7f-40f8-aac1-8bc96cbfe348 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:06.140395 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-af066d57-4123-44f0-a66e-c564acf60ec1 req-6526d3ff-4e7f-40f8-aac1-8bc96cbfe348 service nova] Creating event network-changed:02ba6f53-1c39-4dad-8765-31b24cf07fde for instance 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 on hv-cinder-80403 Nov 24 15:30:06.147195 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-af066d57-4123-44f0-a66e-c564acf60ec1 req-6526d3ff-4e7f-40f8-aac1-8bc96cbfe348 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046590 Nov 24 15:30:06.148240 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 544/1027] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:30:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:30:06.904405 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-19abb561-bc22-4249-b6a1-4f02afb44fb2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:06.904950 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-19abb561-bc22-4249-b6a1-4f02afb44fb2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] [instance: 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:06.911185 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-19abb561-bc22-4249-b6a1-4f02afb44fb2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:06.911668 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-19abb561-bc22-4249-b6a1-4f02afb44fb2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:06.912441 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-19abb561-bc22-4249-b6a1-4f02afb44fb2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:06.912870 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-19abb561-bc22-4249-b6a1-4f02afb44fb2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:07.048744 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-19abb561-bc22-4249-b6a1-4f02afb44fb2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114a8c8cc0f74800b9502dded7e87f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290cbbab53745588528c99ae7f72032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:07.055886 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-19abb561-bc22-4249-b6a1-4f02afb44fb2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] 10.222.0.66 "GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41" status: 200 len: 1314 microversion: 2.1 time: 0.155383 Nov 24 15:30:07.056444 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 484/1028] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:06 2021] GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:08.072965 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-19133f1f-8ae4-47cc-9304-4509f64bfe28 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:08.073456 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-19133f1f-8ae4-47cc-9304-4509f64bfe28 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] [instance: 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:08.080070 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-19133f1f-8ae4-47cc-9304-4509f64bfe28 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:08.080520 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-19133f1f-8ae4-47cc-9304-4509f64bfe28 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:08.081289 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-19133f1f-8ae4-47cc-9304-4509f64bfe28 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:08.081717 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-19133f1f-8ae4-47cc-9304-4509f64bfe28 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:08.208573 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-19133f1f-8ae4-47cc-9304-4509f64bfe28 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114a8c8cc0f74800b9502dded7e87f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290cbbab53745588528c99ae7f72032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:08.215871 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-19133f1f-8ae4-47cc-9304-4509f64bfe28 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] 10.222.0.66 "GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41" status: 200 len: 1314 microversion: 2.1 time: 0.147595 Nov 24 15:30:08.216436 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 545/1029] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:08 2021] GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:09.231713 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8682539d-9bc9-4262-95fe-74267b062ce4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:09.232261 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8682539d-9bc9-4262-95fe-74267b062ce4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] [instance: 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:09.238652 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8682539d-9bc9-4262-95fe-74267b062ce4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:09.239125 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8682539d-9bc9-4262-95fe-74267b062ce4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:09.239891 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8682539d-9bc9-4262-95fe-74267b062ce4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:09.240327 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8682539d-9bc9-4262-95fe-74267b062ce4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:09.370271 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8682539d-9bc9-4262-95fe-74267b062ce4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114a8c8cc0f74800b9502dded7e87f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290cbbab53745588528c99ae7f72032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:09.377937 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8682539d-9bc9-4262-95fe-74267b062ce4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] 10.222.0.66 "GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41" status: 200 len: 1314 microversion: 2.1 time: 0.149965 Nov 24 15:30:09.378497 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 485/1030] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:09 2021] GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:10.394542 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-978d561f-709f-478d-b0aa-1c3e3d5b0b98 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:10.395180 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-978d561f-709f-478d-b0aa-1c3e3d5b0b98 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] [instance: 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:10.401500 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-978d561f-709f-478d-b0aa-1c3e3d5b0b98 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:10.401939 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-978d561f-709f-478d-b0aa-1c3e3d5b0b98 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:10.402763 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-978d561f-709f-478d-b0aa-1c3e3d5b0b98 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:10.403220 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-978d561f-709f-478d-b0aa-1c3e3d5b0b98 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:10.535059 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-978d561f-709f-478d-b0aa-1c3e3d5b0b98 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114a8c8cc0f74800b9502dded7e87f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290cbbab53745588528c99ae7f72032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:10.542403 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-978d561f-709f-478d-b0aa-1c3e3d5b0b98 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] 10.222.0.66 "GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41" status: 200 len: 1314 microversion: 2.1 time: 0.151534 Nov 24 15:30:10.542985 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 546/1031] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:10 2021] GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:10.875555 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-a4d7e322-62b4-429f-8184-73d3325d57f4 req-cb6ad166-2f3a-4fc1-8cac-0a7e46d75a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf02c45-aa44-4c3d-810f-49ee2ab6ad41", "name": "network-vif-plugged", "status": "completed", "tag": "02ba6f53-1c39-4dad-8765-31b24cf07fde"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:30:10.877094 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:30:10.877094 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:30:10.884254 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-a4d7e322-62b4-429f-8184-73d3325d57f4 req-cb6ad166-2f3a-4fc1-8cac-0a7e46d75a75 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:10.884699 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-a4d7e322-62b4-429f-8184-73d3325d57f4 req-cb6ad166-2f3a-4fc1-8cac-0a7e46d75a75 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:10.895747 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-a4d7e322-62b4-429f-8184-73d3325d57f4 req-cb6ad166-2f3a-4fc1-8cac-0a7e46d75a75 service nova] Creating event network-vif-plugged:02ba6f53-1c39-4dad-8765-31b24cf07fde for instance 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 on hv-cinder-80403 Nov 24 15:30:10.900784 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-a4d7e322-62b4-429f-8184-73d3325d57f4 req-cb6ad166-2f3a-4fc1-8cac-0a7e46d75a75 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144820 Nov 24 15:30:10.901332 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 486/1032] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:30:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:30:11.559069 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-adba83d7-0c6d-4a07-80c6-1313fab781b4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:11.559668 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-adba83d7-0c6d-4a07-80c6-1313fab781b4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] [instance: 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:11.566328 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-adba83d7-0c6d-4a07-80c6-1313fab781b4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:11.566771 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-adba83d7-0c6d-4a07-80c6-1313fab781b4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:11.567561 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-adba83d7-0c6d-4a07-80c6-1313fab781b4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:11.567987 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-adba83d7-0c6d-4a07-80c6-1313fab781b4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:11.692960 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-adba83d7-0c6d-4a07-80c6-1313fab781b4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114a8c8cc0f74800b9502dded7e87f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290cbbab53745588528c99ae7f72032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:11.700177 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-adba83d7-0c6d-4a07-80c6-1313fab781b4 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] 10.222.0.66 "GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41" status: 200 len: 1314 microversion: 2.1 time: 0.144838 Nov 24 15:30:11.700741 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 547/1033] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:11 2021] GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:12.717771 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f92c2beb-593d-4385-a1a0-ab0c1b07d365 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:12.719022 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-f92c2beb-593d-4385-a1a0-ab0c1b07d365 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] [instance: 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:12.725508 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f92c2beb-593d-4385-a1a0-ab0c1b07d365 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:12.725953 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f92c2beb-593d-4385-a1a0-ab0c1b07d365 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:12.726724 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f92c2beb-593d-4385-a1a0-ab0c1b07d365 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:12.727182 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f92c2beb-593d-4385-a1a0-ab0c1b07d365 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:12.859664 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-f92c2beb-593d-4385-a1a0-ab0c1b07d365 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114a8c8cc0f74800b9502dded7e87f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290cbbab53745588528c99ae7f72032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:12.867066 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f92c2beb-593d-4385-a1a0-ab0c1b07d365 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] 10.222.0.66 "GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41" status: 200 len: 1464 microversion: 2.1 time: 0.153335 Nov 24 15:30:12.867626 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 487/1034] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:12 2021] GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:12.903111 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-32dcc56f-70fd-4286-8caf-3ce9cb83c2b2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:12.903631 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-32dcc56f-70fd-4286-8caf-3ce9cb83c2b2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] [instance: 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:12.910492 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-32dcc56f-70fd-4286-8caf-3ce9cb83c2b2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:12.910973 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-32dcc56f-70fd-4286-8caf-3ce9cb83c2b2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:12.911755 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-32dcc56f-70fd-4286-8caf-3ce9cb83c2b2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:12.912188 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-32dcc56f-70fd-4286-8caf-3ce9cb83c2b2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:12.935885 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-32dcc56f-70fd-4286-8caf-3ce9cb83c2b2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] [instance: 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:30:13.008841 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-32dcc56f-70fd-4286-8caf-3ce9cb83c2b2 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41" status: 204 len: 0 microversion: 2.1 time: 0.108984 Nov 24 15:30:13.009621 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 548/1035] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:30:12 2021] DELETE /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:30:13.019933 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-94a1091c-f408-4ca0-9aac-8c68a66af6e3 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:13.020535 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-94a1091c-f408-4ca0-9aac-8c68a66af6e3 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] [instance: 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:13.026280 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-94a1091c-f408-4ca0-9aac-8c68a66af6e3 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:13.026726 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-94a1091c-f408-4ca0-9aac-8c68a66af6e3 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:13.027518 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-94a1091c-f408-4ca0-9aac-8c68a66af6e3 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:13.027948 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-94a1091c-f408-4ca0-9aac-8c68a66af6e3 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:13.155440 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-94a1091c-f408-4ca0-9aac-8c68a66af6e3 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114a8c8cc0f74800b9502dded7e87f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290cbbab53745588528c99ae7f72032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:13.162676 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-94a1091c-f408-4ca0-9aac-8c68a66af6e3 tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] 10.222.0.66 "GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41" status: 200 len: 1470 microversion: 2.1 time: 0.148127 Nov 24 15:30:13.163252 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 488/1036] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:13 2021] GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:14.180417 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e725d49a-e410-475a-abcd-d205e6947c4b tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:14.181102 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e725d49a-e410-475a-abcd-d205e6947c4b tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] [instance: 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:14.187318 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e725d49a-e410-475a-abcd-d205e6947c4b tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:14.187761 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e725d49a-e410-475a-abcd-d205e6947c4b tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:14.188529 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e725d49a-e410-475a-abcd-d205e6947c4b tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:14.188962 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e725d49a-e410-475a-abcd-d205e6947c4b tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:14.322496 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e725d49a-e410-475a-abcd-d205e6947c4b tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '114a8c8cc0f74800b9502dded7e87f64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4290cbbab53745588528c99ae7f72032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:14.330582 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e725d49a-e410-475a-abcd-d205e6947c4b tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] 10.222.0.66 "GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41" status: 200 len: 1470 microversion: 2.1 time: 0.154106 Nov 24 15:30:14.331349 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 549/1037] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:14 2021] GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:14.768294 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-be5d5fa2-50f4-4986-a22d-4e3d034105a9 req-3d652818-017c-4cdc-9e82-7a1203338835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bf02c45-aa44-4c3d-810f-49ee2ab6ad41", "name": "network-vif-deleted", "tag": "02ba6f53-1c39-4dad-8765-31b24cf07fde"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:30:14.770341 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:30:14.770341 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:30:14.780086 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-be5d5fa2-50f4-4986-a22d-4e3d034105a9 req-3d652818-017c-4cdc-9e82-7a1203338835 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:14.780624 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-be5d5fa2-50f4-4986-a22d-4e3d034105a9 req-3d652818-017c-4cdc-9e82-7a1203338835 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:14.792650 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-be5d5fa2-50f4-4986-a22d-4e3d034105a9 req-3d652818-017c-4cdc-9e82-7a1203338835 service nova] Creating event network-vif-deleted:02ba6f53-1c39-4dad-8765-31b24cf07fde for instance 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 on hv-cinder-80403 Nov 24 15:30:14.799084 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-be5d5fa2-50f4-4986-a22d-4e3d034105a9 req-3d652818-017c-4cdc-9e82-7a1203338835 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035098 Nov 24 15:30:14.799687 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 489/1038] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:30:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:30:15.348276 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b9fa4db7-4fd9-4776-a830-01f76f3f86bc tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:15.348797 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b9fa4db7-4fd9-4776-a830-01f76f3f86bc tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] [instance: 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:15.355067 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b9fa4db7-4fd9-4776-a830-01f76f3f86bc tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:15.355516 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b9fa4db7-4fd9-4776-a830-01f76f3f86bc tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:15.356294 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b9fa4db7-4fd9-4776-a830-01f76f3f86bc tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:15.356726 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b9fa4db7-4fd9-4776-a830-01f76f3f86bc tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:15.370491 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.wsgi [None req-b9fa4db7-4fd9-4776-a830-01f76f3f86bc tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] HTTP exception thrown: Instance 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 could not be found. Nov 24 15:30:15.371094 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b9fa4db7-4fd9-4776-a830-01f76f3f86bc tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] Returning 404 to user: Instance 2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 could not be found. {{(pid=116072) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:30:15.371927 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b9fa4db7-4fd9-4776-a830-01f76f3f86bc tempest-VolumesNegativeTest-1679640158 tempest-VolumesNegativeTest-1679640158-project] 10.222.0.66 "GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41" status: 404 len: 111 microversion: 2.1 time: 0.027439 Nov 24 15:30:15.372493 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 550/1039] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:15 2021] GET /compute/v2.1/servers/2bf02c45-aa44-4c3d-810f-49ee2ab6ad41 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:30:38.866042 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-983a16a6-4fab-426d-9b8a-1bbb05bba744 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Action: 'create', calling method: .version_select at 0x7f930cbf61f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-677945594"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:30:38.881190 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-983a16a6-4fab-426d-9b8a-1bbb05bba744 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Getting quotas for project 43561d39a3aa4b6390447a9f4f77d4e4. Resources: {'key_pairs'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:30:38.885247 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-983a16a6-4fab-426d-9b8a-1bbb05bba744 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Getting quotas for user de80792036a946fe8ca7c8abef2d5d3c and project 43561d39a3aa4b6390447a9f4f77d4e4. Resources: {'key_pairs'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:30:39.373800 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-983a16a6-4fab-426d-9b8a-1bbb05bba744 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Getting quotas for project 43561d39a3aa4b6390447a9f4f77d4e4. Resources: {'key_pairs'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:30:39.377543 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.quota [None req-983a16a6-4fab-426d-9b8a-1bbb05bba744 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Getting quotas for user de80792036a946fe8ca7c8abef2d5d3c and project 43561d39a3aa4b6390447a9f4f77d4e4. Resources: {'key_pairs'} {{(pid=116073) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:30:39.390308 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-983a16a6-4fab-426d-9b8a-1bbb05bba744 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.528448 Nov 24 15:30:39.390929 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 490/1040] 10.222.0.66 () {60 vars in 1157 bytes} [Wed Nov 24 15:30:38 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:39.440269 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1666158030", "imageRef": "b34a714b-9c54-4d69-bb73-a6a0bae10810", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-677945594", "networks": [{"uuid": "db54b14e-d81b-403a-a7f2-afe04d2df659"}]}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:30:39.489540 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.network.neutron [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] validate_networks() for [('db54b14e-d81b-403a-a7f2-afe04d2df659', None, None, None, None, None)] {{(pid=116072) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 24 15:30:39.862373 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Flavor limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 24 15:30:39.863072 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Image limits 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 24 15:30:39.863537 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Flavor pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 24 15:30:39.863937 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Image pref 0:0:0 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 24 15:30:39.864340 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.virt.hardware [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116072) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 24 15:30:39.872946 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:39.873389 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:39.874181 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:39.874610 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:39.891744 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Getting quotas for project 43561d39a3aa4b6390447a9f4f77d4e4. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 24 15:30:39.895653 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.quota [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Getting quotas for user de80792036a946fe8ca7c8abef2d5d3c and project 43561d39a3aa4b6390447a9f4f77d4e4. Resources: {'ram', 'cores', 'instances'} {{(pid=116072) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 24 15:30:39.906624 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Going to run 1 instances... {{(pid=116072) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 24 15:30:39.908872 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b34a714b-9c54-4d69-bb73-a6a0bae10810',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116072) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 24 15:30:39.953780 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-68db13d7-97b2-406f-b790-5cd85c3491b9 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517439 Nov 24 15:30:39.955092 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 551/1041] 10.222.0.66 () {60 vars in 1146 bytes} [Wed Nov 24 15:30:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 24 15:30:39.964688 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f3ab3958-a2b9-432e-9f35-04da2b483852 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:39.965411 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-f3ab3958-a2b9-432e-9f35-04da2b483852 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:40.019968 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-f3ab3958-a2b9-432e-9f35-04da2b483852 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:40.027092 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f3ab3958-a2b9-432e-9f35-04da2b483852 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1258 microversion: 2.1 time: 0.066494 Nov 24 15:30:40.027657 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 491/1042] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:39 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:41.043909 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-508be9bc-e05f-4044-967a-8f4b72908d52 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:41.044693 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-508be9bc-e05f-4044-967a-8f4b72908d52 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:41.051396 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-508be9bc-e05f-4044-967a-8f4b72908d52 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:41.051934 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-508be9bc-e05f-4044-967a-8f4b72908d52 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:41.052788 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-508be9bc-e05f-4044-967a-8f4b72908d52 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:41.053285 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-508be9bc-e05f-4044-967a-8f4b72908d52 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:41.115759 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-508be9bc-e05f-4044-967a-8f4b72908d52 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:41.123597 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-508be9bc-e05f-4044-967a-8f4b72908d52 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1316 microversion: 2.1 time: 0.083586 Nov 24 15:30:41.124388 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 552/1043] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:41 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1316 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:42.141377 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2fbe3fd1-8a9d-432c-9179-5b42906b387d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:42.141901 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2fbe3fd1-8a9d-432c-9179-5b42906b387d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:42.148136 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2fbe3fd1-8a9d-432c-9179-5b42906b387d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:42.148583 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2fbe3fd1-8a9d-432c-9179-5b42906b387d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:42.149619 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2fbe3fd1-8a9d-432c-9179-5b42906b387d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:42.149787 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2fbe3fd1-8a9d-432c-9179-5b42906b387d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:42.304644 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-2fbe3fd1-8a9d-432c-9179-5b42906b387d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:42.315139 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2fbe3fd1-8a9d-432c-9179-5b42906b387d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.177945 Nov 24 15:30:42.316343 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 492/1044] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:42 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:43.332161 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-3f800bf8-e16c-4f54-9b94-943db292def1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:43.333469 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-3f800bf8-e16c-4f54-9b94-943db292def1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:43.340175 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f800bf8-e16c-4f54-9b94-943db292def1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:43.340716 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f800bf8-e16c-4f54-9b94-943db292def1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:43.341571 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f800bf8-e16c-4f54-9b94-943db292def1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:43.342077 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-3f800bf8-e16c-4f54-9b94-943db292def1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:43.480240 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-3f800bf8-e16c-4f54-9b94-943db292def1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:43.488617 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-3f800bf8-e16c-4f54-9b94-943db292def1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.160006 Nov 24 15:30:43.495883 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 553/1045] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:43 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:44.506077 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-840eb092-d0b0-49ad-b57b-a801cf477071 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:44.506678 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-840eb092-d0b0-49ad-b57b-a801cf477071 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:44.513164 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-840eb092-d0b0-49ad-b57b-a801cf477071 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:44.513609 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-840eb092-d0b0-49ad-b57b-a801cf477071 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:44.515003 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-840eb092-d0b0-49ad-b57b-a801cf477071 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:44.515434 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-840eb092-d0b0-49ad-b57b-a801cf477071 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:44.660812 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-840eb092-d0b0-49ad-b57b-a801cf477071 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:44.668817 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-840eb092-d0b0-49ad-b57b-a801cf477071 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.166379 Nov 24 15:30:44.669748 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 493/1046] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:44 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:30:45.689502 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-45d51612-7506-4981-8d6f-920cb5e8e202 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:45.690377 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-45d51612-7506-4981-8d6f-920cb5e8e202 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:45.698486 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45d51612-7506-4981-8d6f-920cb5e8e202 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:45.699355 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45d51612-7506-4981-8d6f-920cb5e8e202 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:45.700373 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45d51612-7506-4981-8d6f-920cb5e8e202 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:45.701037 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-45d51612-7506-4981-8d6f-920cb5e8e202 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:45.837390 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-45d51612-7506-4981-8d6f-920cb5e8e202 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:45.844706 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-45d51612-7506-4981-8d6f-920cb5e8e202 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.162637 Nov 24 15:30:45.845261 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 554/1047] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:45 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:46.861619 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-543e20b9-792f-47dc-a554-f25623e2106c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:46.862219 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-543e20b9-792f-47dc-a554-f25623e2106c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:46.873304 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-543e20b9-792f-47dc-a554-f25623e2106c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:46.874631 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-543e20b9-792f-47dc-a554-f25623e2106c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:46.876361 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-543e20b9-792f-47dc-a554-f25623e2106c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:46.876801 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-543e20b9-792f-47dc-a554-f25623e2106c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:47.025268 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-543e20b9-792f-47dc-a554-f25623e2106c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:47.033127 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-543e20b9-792f-47dc-a554-f25623e2106c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.175239 Nov 24 15:30:47.033680 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 494/1048] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:46 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:48.049872 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-ce08492e-2e7d-4fda-9682-104c5f20a79c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:48.050494 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-ce08492e-2e7d-4fda-9682-104c5f20a79c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:48.058571 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ce08492e-2e7d-4fda-9682-104c5f20a79c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:48.059151 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ce08492e-2e7d-4fda-9682-104c5f20a79c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:48.060045 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ce08492e-2e7d-4fda-9682-104c5f20a79c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:48.060552 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-ce08492e-2e7d-4fda-9682-104c5f20a79c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:48.256984 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-ce08492e-2e7d-4fda-9682-104c5f20a79c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:48.266969 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-ce08492e-2e7d-4fda-9682-104c5f20a79c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.221145 Nov 24 15:30:48.267750 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 555/1049] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:48 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:30:49.291165 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c0a695b2-df0a-47ca-98ba-aafc853309a8 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:49.291798 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c0a695b2-df0a-47ca-98ba-aafc853309a8 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:49.298704 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c0a695b2-df0a-47ca-98ba-aafc853309a8 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:49.299164 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c0a695b2-df0a-47ca-98ba-aafc853309a8 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:49.299958 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c0a695b2-df0a-47ca-98ba-aafc853309a8 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:49.300394 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c0a695b2-df0a-47ca-98ba-aafc853309a8 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:49.438096 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c0a695b2-df0a-47ca-98ba-aafc853309a8 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:49.448763 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c0a695b2-df0a-47ca-98ba-aafc853309a8 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.160868 Nov 24 15:30:49.458948 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 495/1050] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:49 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:50.470337 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b0d5a67c-d5bd-4a03-ba8e-bf7ec0628a1c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:50.471475 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b0d5a67c-d5bd-4a03-ba8e-bf7ec0628a1c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:50.482451 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b0d5a67c-d5bd-4a03-ba8e-bf7ec0628a1c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:50.482451 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b0d5a67c-d5bd-4a03-ba8e-bf7ec0628a1c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:50.489909 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b0d5a67c-d5bd-4a03-ba8e-bf7ec0628a1c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:50.490512 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b0d5a67c-d5bd-4a03-ba8e-bf7ec0628a1c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:50.685130 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b0d5a67c-d5bd-4a03-ba8e-bf7ec0628a1c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:50.703101 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b0d5a67c-d5bd-4a03-ba8e-bf7ec0628a1c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.240071 Nov 24 15:30:50.704398 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 556/1051] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:50 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:51.721403 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-545e3858-3a1a-440b-b2dd-7ab0d698321d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:51.722098 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-545e3858-3a1a-440b-b2dd-7ab0d698321d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:51.728699 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-545e3858-3a1a-440b-b2dd-7ab0d698321d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:51.729109 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-545e3858-3a1a-440b-b2dd-7ab0d698321d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:51.729889 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-545e3858-3a1a-440b-b2dd-7ab0d698321d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:51.730380 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-545e3858-3a1a-440b-b2dd-7ab0d698321d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:51.916057 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-545e3858-3a1a-440b-b2dd-7ab0d698321d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:51.924166 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-545e3858-3a1a-440b-b2dd-7ab0d698321d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.206478 Nov 24 15:30:51.927167 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 496/1052] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:51 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:52.940596 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6bdca0e4-c509-4f8b-8e65-ea1db7035cfd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:52.941297 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6bdca0e4-c509-4f8b-8e65-ea1db7035cfd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:52.947766 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6bdca0e4-c509-4f8b-8e65-ea1db7035cfd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:52.948281 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6bdca0e4-c509-4f8b-8e65-ea1db7035cfd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:52.949124 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6bdca0e4-c509-4f8b-8e65-ea1db7035cfd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:52.949555 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6bdca0e4-c509-4f8b-8e65-ea1db7035cfd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:53.083505 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6bdca0e4-c509-4f8b-8e65-ea1db7035cfd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:53.091265 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6bdca0e4-c509-4f8b-8e65-ea1db7035cfd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.154418 Nov 24 15:30:53.091872 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 557/1053] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:52 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:54.053177 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-a90abce9-8eee-43ec-a494-e564ea1377e7 req-1d6578bd-063e-4cb8-863e-a66c49470e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c58463f5-527b-475e-a4c9-ca70f2d5f00f", "tag": "974425b6-c12e-4d5b-a19b-b1237f431c83"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:30:54.054765 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:30:54.054765 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:30:54.062270 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-a90abce9-8eee-43ec-a494-e564ea1377e7 req-1d6578bd-063e-4cb8-863e-a66c49470e3e service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:54.062717 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-a90abce9-8eee-43ec-a494-e564ea1377e7 req-1d6578bd-063e-4cb8-863e-a66c49470e3e service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:54.077641 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-a90abce9-8eee-43ec-a494-e564ea1377e7 req-1d6578bd-063e-4cb8-863e-a66c49470e3e service nova] Creating event network-changed:974425b6-c12e-4d5b-a19b-b1237f431c83 for instance c58463f5-527b-475e-a4c9-ca70f2d5f00f on hv-cinder-80403 Nov 24 15:30:54.083073 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-a90abce9-8eee-43ec-a494-e564ea1377e7 req-1d6578bd-063e-4cb8-863e-a66c49470e3e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227106 Nov 24 15:30:54.083818 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 497/1054] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:30:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:30:54.108158 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e0691691-f146-43cd-8073-a93d062dc248 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:54.108779 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e0691691-f146-43cd-8073-a93d062dc248 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:54.115686 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0691691-f146-43cd-8073-a93d062dc248 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:54.116132 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0691691-f146-43cd-8073-a93d062dc248 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:54.116920 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0691691-f146-43cd-8073-a93d062dc248 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:54.117350 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e0691691-f146-43cd-8073-a93d062dc248 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:54.269286 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e0691691-f146-43cd-8073-a93d062dc248 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:54.277287 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e0691691-f146-43cd-8073-a93d062dc248 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.172727 Nov 24 15:30:54.277864 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 558/1055] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:54 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:55.294300 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-8bfc7579-daaf-4682-a212-b914153c2c79 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:55.295119 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-8bfc7579-daaf-4682-a212-b914153c2c79 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:55.302112 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8bfc7579-daaf-4682-a212-b914153c2c79 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:55.302596 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8bfc7579-daaf-4682-a212-b914153c2c79 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:55.303442 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8bfc7579-daaf-4682-a212-b914153c2c79 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:55.303875 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-8bfc7579-daaf-4682-a212-b914153c2c79 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:55.437802 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-8bfc7579-daaf-4682-a212-b914153c2c79 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:55.445206 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-8bfc7579-daaf-4682-a212-b914153c2c79 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.155406 Nov 24 15:30:55.445809 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 498/1056] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:55 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:56.465097 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-4dfcdb72-92a4-4132-944b-d6e52161061d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:56.465701 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-4dfcdb72-92a4-4132-944b-d6e52161061d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:56.472088 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4dfcdb72-92a4-4132-944b-d6e52161061d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:56.472533 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4dfcdb72-92a4-4132-944b-d6e52161061d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:56.473309 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4dfcdb72-92a4-4132-944b-d6e52161061d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:56.473743 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-4dfcdb72-92a4-4132-944b-d6e52161061d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:56.601121 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-4dfcdb72-92a4-4132-944b-d6e52161061d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:56.608975 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-4dfcdb72-92a4-4132-944b-d6e52161061d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.147586 Nov 24 15:30:56.609540 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 559/1057] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:56 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:57.625867 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-05f5bb87-ecec-4e65-ab65-0bd5a2db2f51 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:57.626482 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-05f5bb87-ecec-4e65-ab65-0bd5a2db2f51 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:57.632961 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-05f5bb87-ecec-4e65-ab65-0bd5a2db2f51 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:57.633407 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-05f5bb87-ecec-4e65-ab65-0bd5a2db2f51 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:57.634192 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-05f5bb87-ecec-4e65-ab65-0bd5a2db2f51 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:57.634624 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-05f5bb87-ecec-4e65-ab65-0bd5a2db2f51 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:57.768215 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-05f5bb87-ecec-4e65-ab65-0bd5a2db2f51 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:57.775665 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-05f5bb87-ecec-4e65-ab65-0bd5a2db2f51 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.153978 Nov 24 15:30:57.776230 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 499/1058] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:57 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:58.792137 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-19681591-c4de-4bd6-82f4-5fb7c82b0ca2 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:58.792741 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-19681591-c4de-4bd6-82f4-5fb7c82b0ca2 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:58.799714 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-19681591-c4de-4bd6-82f4-5fb7c82b0ca2 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:58.800167 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-19681591-c4de-4bd6-82f4-5fb7c82b0ca2 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:58.800948 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-19681591-c4de-4bd6-82f4-5fb7c82b0ca2 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:58.801372 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-19681591-c4de-4bd6-82f4-5fb7c82b0ca2 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:58.936266 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-19681591-c4de-4bd6-82f4-5fb7c82b0ca2 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:30:58.943436 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-19681591-c4de-4bd6-82f4-5fb7c82b0ca2 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.154962 Nov 24 15:30:58.944011 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 560/1059] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:58 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:30:59.087632 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-6d072635-9e1a-4894-a26d-aefa58397b78 req-b72bb790-6e79-4207-8949-747a0a5304b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c58463f5-527b-475e-a4c9-ca70f2d5f00f", "name": "network-vif-plugged", "status": "completed", "tag": "974425b6-c12e-4d5b-a19b-b1237f431c83"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:30:59.089128 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:30:59.089128 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:30:59.097009 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-6d072635-9e1a-4894-a26d-aefa58397b78 req-b72bb790-6e79-4207-8949-747a0a5304b6 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:59.097460 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-6d072635-9e1a-4894-a26d-aefa58397b78 req-b72bb790-6e79-4207-8949-747a0a5304b6 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:59.109339 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-6d072635-9e1a-4894-a26d-aefa58397b78 req-b72bb790-6e79-4207-8949-747a0a5304b6 service nova] Creating event network-vif-plugged:974425b6-c12e-4d5b-a19b-b1237f431c83 for instance c58463f5-527b-475e-a4c9-ca70f2d5f00f on hv-cinder-80403 Nov 24 15:30:59.114196 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-6d072635-9e1a-4894-a26d-aefa58397b78 req-b72bb790-6e79-4207-8949-747a0a5304b6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030350 Nov 24 15:30:59.114982 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 500/1060] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:30:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:30:59.959433 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-08b75587-3147-4cc5-b0d8-a3a582a73a08 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:30:59.960031 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-08b75587-3147-4cc5-b0d8-a3a582a73a08 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:30:59.966716 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-08b75587-3147-4cc5-b0d8-a3a582a73a08 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:59.967189 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-08b75587-3147-4cc5-b0d8-a3a582a73a08 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:30:59.967958 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-08b75587-3147-4cc5-b0d8-a3a582a73a08 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:30:59.968384 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-08b75587-3147-4cc5-b0d8-a3a582a73a08 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:00.097799 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-08b75587-3147-4cc5-b0d8-a3a582a73a08 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:00.105075 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-08b75587-3147-4cc5-b0d8-a3a582a73a08 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1358 microversion: 2.1 time: 0.149269 Nov 24 15:31:00.105635 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 561/1061] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:30:59 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:01.124942 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-100c11ee-6f66-4901-a4d5-651c5b7f0e19 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:01.125632 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-100c11ee-6f66-4901-a4d5-651c5b7f0e19 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:01.131779 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-100c11ee-6f66-4901-a4d5-651c5b7f0e19 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:01.132224 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-100c11ee-6f66-4901-a4d5-651c5b7f0e19 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:01.133023 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-100c11ee-6f66-4901-a4d5-651c5b7f0e19 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:01.133425 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-100c11ee-6f66-4901-a4d5-651c5b7f0e19 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:01.260780 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-100c11ee-6f66-4901-a4d5-651c5b7f0e19 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:01.268914 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-100c11ee-6f66-4901-a4d5-651c5b7f0e19 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1548 microversion: 2.1 time: 0.149431 Nov 24 15:31:01.269463 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 501/1062] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:01 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:01.285110 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-6a5b14ab-42c4-4037-ac01-72fc7a45387a tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:01.285711 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-6a5b14ab-42c4-4037-ac01-72fc7a45387a tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:01.292175 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a5b14ab-42c4-4037-ac01-72fc7a45387a tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:01.292621 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a5b14ab-42c4-4037-ac01-72fc7a45387a tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:01.293527 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a5b14ab-42c4-4037-ac01-72fc7a45387a tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:01.294018 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-6a5b14ab-42c4-4037-ac01-72fc7a45387a tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:01.422962 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-6a5b14ab-42c4-4037-ac01-72fc7a45387a tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:01.430188 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-6a5b14ab-42c4-4037-ac01-72fc7a45387a tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1548 microversion: 2.1 time: 0.148871 Nov 24 15:31:01.430776 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 562/1063] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:01 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:01.446070 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-2a7babfc-9481-4861-a792-3eccfe570492 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:01.449350 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:31:01.449350 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:31:01.450326 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-2a7babfc-9481-4861-a792-3eccfe570492 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:01.451090 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-2a7babfc-9481-4861-a792-3eccfe570492 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Searching by: {'deleted': False, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4'} {{(pid=116073) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 24 15:31:01.457619 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2a7babfc-9481-4861-a792-3eccfe570492 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:01.458059 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2a7babfc-9481-4861-a792-3eccfe570492 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:01.458896 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2a7babfc-9481-4861-a792-3eccfe570492 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:01.459332 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-2a7babfc-9481-4861-a792-3eccfe570492 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:01.547348 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.multi_cell_list [None req-2a7babfc-9481-4861-a792-3eccfe570492 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116073) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 24 15:31:01.641598 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-2a7babfc-9481-4861-a792-3eccfe570492 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198923 Nov 24 15:31:01.642178 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 502/1064] 10.222.0.66 () {58 vars in 1124 bytes} [Wed Nov 24 15:31:01 2021] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:31:01.652083 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-b6bb80fb-5602-4f3b-b8c8-b2ab634f18fd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:01.652688 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-b6bb80fb-5602-4f3b-b8c8-b2ab634f18fd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:01.658521 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b6bb80fb-5602-4f3b-b8c8-b2ab634f18fd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:01.659004 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b6bb80fb-5602-4f3b-b8c8-b2ab634f18fd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:01.659781 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b6bb80fb-5602-4f3b-b8c8-b2ab634f18fd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:01.660215 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-b6bb80fb-5602-4f3b-b8c8-b2ab634f18fd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:01.785910 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-b6bb80fb-5602-4f3b-b8c8-b2ab634f18fd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:01.793153 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-b6bb80fb-5602-4f3b-b8c8-b2ab634f18fd tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1548 microversion: 2.1 time: 0.144650 Nov 24 15:31:01.793713 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 563/1065] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:01 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1548 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:03.275839 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-464ee667-b75f-4667-ab00-b3ad15795038 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8e4a10c-e248-4072-814b-9768e5746361"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:31:03.276885 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-464ee667-b75f-4667-ab00-b3ad15795038 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:03.283760 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-464ee667-b75f-4667-ab00-b3ad15795038 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:03.284212 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-464ee667-b75f-4667-ab00-b3ad15795038 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:03.284982 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-464ee667-b75f-4667-ab00-b3ad15795038 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:03.285416 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-464ee667-b75f-4667-ab00-b3ad15795038 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:03.507224 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-464ee667-b75f-4667-ab00-b3ad15795038 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "POST /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.234460 Nov 24 15:31:03.507925 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 503/1066] 10.222.0.66 () {60 vars in 1322 bytes} [Wed Nov 24 15:31:03 2021] POST /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/os-volume_attachments => generated 194 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:31:09.961460 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-e2a329cd-d0ac-4376-8ced-81ee68b68185 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:09.962175 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-e2a329cd-d0ac-4376-8ced-81ee68b68185 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:09.969137 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2a329cd-d0ac-4376-8ced-81ee68b68185 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:09.969588 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2a329cd-d0ac-4376-8ced-81ee68b68185 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:09.970365 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2a329cd-d0ac-4376-8ced-81ee68b68185 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:09.970793 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-e2a329cd-d0ac-4376-8ced-81ee68b68185 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:10.096961 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-e2a329cd-d0ac-4376-8ced-81ee68b68185 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:10.104813 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-e2a329cd-d0ac-4376-8ced-81ee68b68185 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1594 microversion: 2.1 time: 0.146976 Nov 24 15:31:10.105376 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 564/1067] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:09 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1594 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:12.035167 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-ef088621-25d7-4133-910a-ac96f1286aac req-1207fd7c-8459-4f57-9d6c-e38a29a9302c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c58463f5-527b-475e-a4c9-ca70f2d5f00f", "tag": "974425b6-c12e-4d5b-a19b-b1237f431c83"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:31:12.036692 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:31:12.036692 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:31:12.043798 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-ef088621-25d7-4133-910a-ac96f1286aac req-1207fd7c-8459-4f57-9d6c-e38a29a9302c service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:12.044243 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-ef088621-25d7-4133-910a-ac96f1286aac req-1207fd7c-8459-4f57-9d6c-e38a29a9302c service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:12.057067 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-ef088621-25d7-4133-910a-ac96f1286aac req-1207fd7c-8459-4f57-9d6c-e38a29a9302c service nova] Creating event network-changed:974425b6-c12e-4d5b-a19b-b1237f431c83 for instance c58463f5-527b-475e-a4c9-ca70f2d5f00f on hv-cinder-80403 Nov 24 15:31:12.063199 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-ef088621-25d7-4133-910a-ac96f1286aac req-1207fd7c-8459-4f57-9d6c-e38a29a9302c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087946 Nov 24 15:31:12.063866 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 504/1068] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:31:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:31:12.977274 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-c765bdc6-5cfc-4b27-b86d-f194c984d2ad tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1590255087"}} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:31:12.977810 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-c765bdc6-5cfc-4b27-b86d-f194c984d2ad tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:12.984077 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c765bdc6-5cfc-4b27-b86d-f194c984d2ad tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:12.984515 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c765bdc6-5cfc-4b27-b86d-f194c984d2ad tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:12.985283 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c765bdc6-5cfc-4b27-b86d-f194c984d2ad tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:12.985708 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-c765bdc6-5cfc-4b27-b86d-f194c984d2ad tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:13.119068 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.network.security_group_api [None req-c765bdc6-5cfc-4b27-b86d-f194c984d2ad tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Adding security group 7538ebd7-0d46-4d73-827d-884ad3abbe85 to port 974425b6-c12e-4d5b-a19b-b1237f431c83 Nov 24 15:31:13.461451 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-c765bdc6-5cfc-4b27-b86d-f194c984d2ad tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "POST /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/action" status: 202 len: 0 microversion: 2.1 time: 0.486755 Nov 24 15:31:13.465763 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 565/1069] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:31:12 2021] POST /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:31:13.472707 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-c5460962-71fa-478b-a9fc-42c80fed91b3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:13.473791 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-c5460962-71fa-478b-a9fc-42c80fed91b3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:13.494970 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c5460962-71fa-478b-a9fc-42c80fed91b3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:13.495423 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c5460962-71fa-478b-a9fc-42c80fed91b3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:13.496220 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c5460962-71fa-478b-a9fc-42c80fed91b3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:13.496662 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-c5460962-71fa-478b-a9fc-42c80fed91b3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:13.659055 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-c5460962-71fa-478b-a9fc-42c80fed91b3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:13.666983 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-c5460962-71fa-478b-a9fc-42c80fed91b3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1759 microversion: 2.1 time: 0.199827 Nov 24 15:31:13.667564 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 505/1070] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:13 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1759 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 24 15:31:14.079193 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-2e1dc436-4928-4060-b7b6-ff2a64013029 req-8351354b-5427-461a-9fb7-47d115115e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c58463f5-527b-475e-a4c9-ca70f2d5f00f", "tag": "974425b6-c12e-4d5b-a19b-b1237f431c83"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:31:14.080882 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:31:14.080882 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:31:14.088220 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-2e1dc436-4928-4060-b7b6-ff2a64013029 req-8351354b-5427-461a-9fb7-47d115115e21 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:14.088746 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-2e1dc436-4928-4060-b7b6-ff2a64013029 req-8351354b-5427-461a-9fb7-47d115115e21 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:14.100288 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-2e1dc436-4928-4060-b7b6-ff2a64013029 req-8351354b-5427-461a-9fb7-47d115115e21 service nova] Creating event network-changed:974425b6-c12e-4d5b-a19b-b1237f431c83 for instance c58463f5-527b-475e-a4c9-ca70f2d5f00f on hv-cinder-80403 Nov 24 15:31:14.105593 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-2e1dc436-4928-4060-b7b6-ff2a64013029 req-8351354b-5427-461a-9fb7-47d115115e21 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031038 Nov 24 15:31:14.106234 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 566/1071] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:31:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:31:36.319405 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-9f0dc0e8-1a9c-4f06-be77-a5a8e0914d9f tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:31:36.320399 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-9f0dc0e8-1a9c-4f06-be77-a5a8e0914d9f tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:36.326683 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9f0dc0e8-1a9c-4f06-be77-a5a8e0914d9f tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:36.327169 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9f0dc0e8-1a9c-4f06-be77-a5a8e0914d9f tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:36.327948 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9f0dc0e8-1a9c-4f06-be77-a5a8e0914d9f tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:36.328400 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9f0dc0e8-1a9c-4f06-be77-a5a8e0914d9f tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:36.398224 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-9f0dc0e8-1a9c-4f06-be77-a5a8e0914d9f tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "POST /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/action" status: 202 len: 0 microversion: 2.1 time: 0.082304 Nov 24 15:31:36.398870 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 506/1072] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:31:36 2021] POST /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:31:36.407890 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-69e2f02c-9f39-4cce-984c-a645f008cbc0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:36.408584 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-69e2f02c-9f39-4cce-984c-a645f008cbc0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:36.414687 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69e2f02c-9f39-4cce-984c-a645f008cbc0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:36.415168 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69e2f02c-9f39-4cce-984c-a645f008cbc0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:36.415970 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69e2f02c-9f39-4cce-984c-a645f008cbc0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:36.416396 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-69e2f02c-9f39-4cce-984c-a645f008cbc0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:36.566160 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-69e2f02c-9f39-4cce-984c-a645f008cbc0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:36.574826 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-69e2f02c-9f39-4cce-984c-a645f008cbc0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1751 microversion: 2.1 time: 0.171544 Nov 24 15:31:36.575399 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 567/1073] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:36 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:37.593716 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f828a6c7-ee9c-4767-8ebf-4878bef478e1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:37.594318 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-f828a6c7-ee9c-4767-8ebf-4878bef478e1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:37.600984 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f828a6c7-ee9c-4767-8ebf-4878bef478e1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:37.601426 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f828a6c7-ee9c-4767-8ebf-4878bef478e1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:37.602186 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f828a6c7-ee9c-4767-8ebf-4878bef478e1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:37.602614 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f828a6c7-ee9c-4767-8ebf-4878bef478e1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:37.746664 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-f828a6c7-ee9c-4767-8ebf-4878bef478e1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:37.755012 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f828a6c7-ee9c-4767-8ebf-4878bef478e1 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1756 microversion: 2.1 time: 0.165832 Nov 24 15:31:37.755573 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 507/1074] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:37 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:38.772186 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-8f4bb1a4-cf60-42b4-9da0-b641b5d228d0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:38.772790 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-8f4bb1a4-cf60-42b4-9da0-b641b5d228d0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:38.779124 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8f4bb1a4-cf60-42b4-9da0-b641b5d228d0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:38.779563 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8f4bb1a4-cf60-42b4-9da0-b641b5d228d0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:38.780350 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8f4bb1a4-cf60-42b4-9da0-b641b5d228d0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:38.780778 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-8f4bb1a4-cf60-42b4-9da0-b641b5d228d0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:38.937577 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-8f4bb1a4-cf60-42b4-9da0-b641b5d228d0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:38.945509 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-8f4bb1a4-cf60-42b4-9da0-b641b5d228d0 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1756 microversion: 2.1 time: 0.176993 Nov 24 15:31:38.946079 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 568/1075] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:38 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:39.963352 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-4af302a5-32bc-47bc-931f-522c8c364371 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:39.964100 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-4af302a5-32bc-47bc-931f-522c8c364371 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:39.970264 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4af302a5-32bc-47bc-931f-522c8c364371 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:39.970700 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4af302a5-32bc-47bc-931f-522c8c364371 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:39.971498 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4af302a5-32bc-47bc-931f-522c8c364371 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:39.971923 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-4af302a5-32bc-47bc-931f-522c8c364371 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:40.117131 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-4af302a5-32bc-47bc-931f-522c8c364371 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:40.124801 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-4af302a5-32bc-47bc-931f-522c8c364371 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1756 microversion: 2.1 time: 0.165120 Nov 24 15:31:40.125362 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 508/1076] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:39 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:41.142196 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-fc2c8fb3-0fbf-4ccf-ac93-7dc7c1fa749e tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:41.142799 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-fc2c8fb3-0fbf-4ccf-ac93-7dc7c1fa749e tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:41.149155 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fc2c8fb3-0fbf-4ccf-ac93-7dc7c1fa749e tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:41.149597 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fc2c8fb3-0fbf-4ccf-ac93-7dc7c1fa749e tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:41.150376 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fc2c8fb3-0fbf-4ccf-ac93-7dc7c1fa749e tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:41.150829 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-fc2c8fb3-0fbf-4ccf-ac93-7dc7c1fa749e tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:41.294189 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-fc2c8fb3-0fbf-4ccf-ac93-7dc7c1fa749e tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:41.302454 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-fc2c8fb3-0fbf-4ccf-ac93-7dc7c1fa749e tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1756 microversion: 2.1 time: 0.163933 Nov 24 15:31:41.303045 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 569/1077] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:41 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:42.320029 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-f5816ac6-b6d0-43ca-b201-97d49bc4c091 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:42.320655 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-f5816ac6-b6d0-43ca-b201-97d49bc4c091 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:42.326701 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f5816ac6-b6d0-43ca-b201-97d49bc4c091 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:42.327177 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f5816ac6-b6d0-43ca-b201-97d49bc4c091 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:42.327951 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f5816ac6-b6d0-43ca-b201-97d49bc4c091 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:42.328384 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-f5816ac6-b6d0-43ca-b201-97d49bc4c091 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:42.482798 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-f5816ac6-b6d0-43ca-b201-97d49bc4c091 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:42.492128 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-f5816ac6-b6d0-43ca-b201-97d49bc4c091 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1756 microversion: 2.1 time: 0.175772 Nov 24 15:31:42.492726 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 509/1078] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:42 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:43.509711 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-7854a0da-fcd5-4368-b7bd-ebb0d86a3831 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:43.510303 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-7854a0da-fcd5-4368-b7bd-ebb0d86a3831 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:43.517119 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7854a0da-fcd5-4368-b7bd-ebb0d86a3831 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:43.517538 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7854a0da-fcd5-4368-b7bd-ebb0d86a3831 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:43.518302 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7854a0da-fcd5-4368-b7bd-ebb0d86a3831 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:43.518747 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-7854a0da-fcd5-4368-b7bd-ebb0d86a3831 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:43.664641 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-7854a0da-fcd5-4368-b7bd-ebb0d86a3831 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:43.672444 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-7854a0da-fcd5-4368-b7bd-ebb0d86a3831 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1756 microversion: 2.1 time: 0.166389 Nov 24 15:31:43.673038 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 570/1079] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:43 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:44.689438 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-94425681-ccc5-439b-af5b-6c5379b3e538 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:44.689973 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-94425681-ccc5-439b-af5b-6c5379b3e538 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:44.696419 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-94425681-ccc5-439b-af5b-6c5379b3e538 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:44.696868 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-94425681-ccc5-439b-af5b-6c5379b3e538 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:44.697633 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-94425681-ccc5-439b-af5b-6c5379b3e538 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:44.698063 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-94425681-ccc5-439b-af5b-6c5379b3e538 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:44.843131 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-94425681-ccc5-439b-af5b-6c5379b3e538 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:44.851418 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-94425681-ccc5-439b-af5b-6c5379b3e538 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1756 microversion: 2.1 time: 0.165756 Nov 24 15:31:44.851974 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 510/1080] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:44 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:45.868569 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-d9cbf234-dfc6-46c3-8706-a6830ef80cce tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:45.869175 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-d9cbf234-dfc6-46c3-8706-a6830ef80cce tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:45.875479 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9cbf234-dfc6-46c3-8706-a6830ef80cce tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:45.876537 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9cbf234-dfc6-46c3-8706-a6830ef80cce tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:45.877309 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9cbf234-dfc6-46c3-8706-a6830ef80cce tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:45.877742 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-d9cbf234-dfc6-46c3-8706-a6830ef80cce tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:46.017961 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-d9cbf234-dfc6-46c3-8706-a6830ef80cce tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:46.025757 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-d9cbf234-dfc6-46c3-8706-a6830ef80cce tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1756 microversion: 2.1 time: 0.160930 Nov 24 15:31:46.026337 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 571/1081] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:45 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:47.042471 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-cc670a16-07d9-450f-ac64-450bdeea5c54 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:47.043035 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-cc670a16-07d9-450f-ac64-450bdeea5c54 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:47.049915 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cc670a16-07d9-450f-ac64-450bdeea5c54 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:47.050403 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cc670a16-07d9-450f-ac64-450bdeea5c54 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:47.051502 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cc670a16-07d9-450f-ac64-450bdeea5c54 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:47.052019 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-cc670a16-07d9-450f-ac64-450bdeea5c54 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:47.211798 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-cc670a16-07d9-450f-ac64-450bdeea5c54 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:47.219723 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-cc670a16-07d9-450f-ac64-450bdeea5c54 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1756 microversion: 2.1 time: 0.180889 Nov 24 15:31:47.220295 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 511/1082] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:47 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1756 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:48.239941 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-dc49d5bd-c4b7-48fb-ae2d-9245aa6126ec tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:48.240558 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-dc49d5bd-c4b7-48fb-ae2d-9245aa6126ec tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:48.247004 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc49d5bd-c4b7-48fb-ae2d-9245aa6126ec tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:48.247452 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc49d5bd-c4b7-48fb-ae2d-9245aa6126ec tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:48.248237 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc49d5bd-c4b7-48fb-ae2d-9245aa6126ec tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:48.248670 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-dc49d5bd-c4b7-48fb-ae2d-9245aa6126ec tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:48.390629 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-dc49d5bd-c4b7-48fb-ae2d-9245aa6126ec tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:48.398949 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-dc49d5bd-c4b7-48fb-ae2d-9245aa6126ec tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1756 microversion: 2.1 time: 0.162870 Nov 24 15:31:48.399511 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 572/1083] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:48 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:49.415506 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-9590343f-5984-4f2d-8faf-167eb3099a80 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:49.416120 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-9590343f-5984-4f2d-8faf-167eb3099a80 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:49.422929 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9590343f-5984-4f2d-8faf-167eb3099a80 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:49.423383 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9590343f-5984-4f2d-8faf-167eb3099a80 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:49.424158 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9590343f-5984-4f2d-8faf-167eb3099a80 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:49.424594 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-9590343f-5984-4f2d-8faf-167eb3099a80 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:49.567625 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-9590343f-5984-4f2d-8faf-167eb3099a80 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:49.575368 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-9590343f-5984-4f2d-8faf-167eb3099a80 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1756 microversion: 2.1 time: 0.163562 Nov 24 15:31:49.575928 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 512/1084] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:49 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:50.593231 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f03d478f-7979-4778-94bc-b141eb3123d3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:50.593770 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f03d478f-7979-4778-94bc-b141eb3123d3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:50.600807 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f03d478f-7979-4778-94bc-b141eb3123d3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:50.601273 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f03d478f-7979-4778-94bc-b141eb3123d3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:50.602048 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f03d478f-7979-4778-94bc-b141eb3123d3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:50.602478 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f03d478f-7979-4778-94bc-b141eb3123d3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:50.743736 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f03d478f-7979-4778-94bc-b141eb3123d3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:50.751492 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f03d478f-7979-4778-94bc-b141eb3123d3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1756 microversion: 2.1 time: 0.162025 Nov 24 15:31:50.752063 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 573/1085] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:50 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:51.769077 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-6c84fd6b-3c91-4baf-b123-14f7e1a83d85 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:51.769665 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-6c84fd6b-3c91-4baf-b123-14f7e1a83d85 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:51.776194 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6c84fd6b-3c91-4baf-b123-14f7e1a83d85 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:51.776633 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6c84fd6b-3c91-4baf-b123-14f7e1a83d85 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:51.777396 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6c84fd6b-3c91-4baf-b123-14f7e1a83d85 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:51.777921 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-6c84fd6b-3c91-4baf-b123-14f7e1a83d85 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:51.916514 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-6c84fd6b-3c91-4baf-b123-14f7e1a83d85 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:51.924792 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-6c84fd6b-3c91-4baf-b123-14f7e1a83d85 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1756 microversion: 2.1 time: 0.159432 Nov 24 15:31:51.925354 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 513/1086] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:51 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:31:52.941915 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-38814d4e-6170-4ebc-94e7-bd4c2ed85892 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:31:52.942509 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-38814d4e-6170-4ebc-94e7-bd4c2ed85892 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:31:52.948579 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38814d4e-6170-4ebc-94e7-bd4c2ed85892 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:52.949024 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38814d4e-6170-4ebc-94e7-bd4c2ed85892 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:52.949789 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38814d4e-6170-4ebc-94e7-bd4c2ed85892 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:31:52.950220 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-38814d4e-6170-4ebc-94e7-bd4c2ed85892 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:31:53.093452 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-38814d4e-6170-4ebc-94e7-bd4c2ed85892 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:31:53.101724 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-38814d4e-6170-4ebc-94e7-bd4c2ed85892 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1759 microversion: 2.1 time: 0.163561 Nov 24 15:31:53.102289 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 574/1087] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:31:52 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:32:25.227690 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-19b2ad69-8de4-4275-b6da-be6c9d24874c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1590255087"}} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:32:25.228320 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-19b2ad69-8de4-4275-b6da-be6c9d24874c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:32:25.234167 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-19b2ad69-8de4-4275-b6da-be6c9d24874c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:25.234833 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-19b2ad69-8de4-4275-b6da-be6c9d24874c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:25.235749 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-19b2ad69-8de4-4275-b6da-be6c9d24874c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:25.236353 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-19b2ad69-8de4-4275-b6da-be6c9d24874c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:25.365474 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.network.security_group_api [None req-19b2ad69-8de4-4275-b6da-be6c9d24874c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Removing security group 7538ebd7-0d46-4d73-827d-884ad3abbe85 from port 974425b6-c12e-4d5b-a19b-b1237f431c83 Nov 24 15:32:25.692878 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-19b2ad69-8de4-4275-b6da-be6c9d24874c tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "POST /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/action" status: 202 len: 0 microversion: 2.1 time: 0.468784 Nov 24 15:32:25.695347 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 514/1088] 10.222.0.66 () {60 vars in 1277 bytes} [Wed Nov 24 15:32:25 2021] POST /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/action => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:32:25.706483 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [req-afb47e1b-9611-4ba2-b146-30bc60230fa3 req-8c7e8184-332f-4c6a-9a47-8d17bfd267bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c58463f5-527b-475e-a4c9-ca70f2d5f00f", "tag": "974425b6-c12e-4d5b-a19b-b1237f431c83"}]} {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:32:25.712261 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:32:25.712261 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: warnings.warn(msg) Nov 24 15:32:25.727707 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-afb47e1b-9611-4ba2-b146-30bc60230fa3 req-8c7e8184-332f-4c6a-9a47-8d17bfd267bd service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:25.728167 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [req-afb47e1b-9611-4ba2-b146-30bc60230fa3 req-8c7e8184-332f-4c6a-9a47-8d17bfd267bd service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:25.758988 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.compute.server_external_events [req-afb47e1b-9611-4ba2-b146-30bc60230fa3 req-8c7e8184-332f-4c6a-9a47-8d17bfd267bd service nova] Creating event network-changed:974425b6-c12e-4d5b-a19b-b1237f431c83 for instance c58463f5-527b-475e-a4c9-ca70f2d5f00f on hv-cinder-80403 Nov 24 15:32:25.767476 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [req-afb47e1b-9611-4ba2-b146-30bc60230fa3 req-8c7e8184-332f-4c6a-9a47-8d17bfd267bd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069399 Nov 24 15:32:25.770834 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 575/1089] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:32:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:32:27.084005 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-b3b6f790-e14b-492b-a593-f135ea2cda8b tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:32:27.084609 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-b3b6f790-e14b-492b-a593-f135ea2cda8b tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:32:27.090664 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b3b6f790-e14b-492b-a593-f135ea2cda8b tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:27.091152 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b3b6f790-e14b-492b-a593-f135ea2cda8b tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:27.091937 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b3b6f790-e14b-492b-a593-f135ea2cda8b tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:27.092377 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-b3b6f790-e14b-492b-a593-f135ea2cda8b tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:27.170536 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.objects.instance [None req-b3b6f790-e14b-492b-a593-f135ea2cda8b tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lazy-loading 'services' on Instance uuid c58463f5-527b-475e-a4c9-ca70f2d5f00f {{(pid=116073) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:32:27.243878 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-b3b6f790-e14b-492b-a593-f135ea2cda8b tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/os-volume_attachments/e8e4a10c-e248-4072-814b-9768e5746361" status: 202 len: 0 microversion: 2.1 time: 0.163990 Nov 24 15:32:27.244795 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 515/1090] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Nov 24 15:32:27 2021] DELETE /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/os-volume_attachments/e8e4a10c-e248-4072-814b-9768e5746361 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:32:27.254114 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-2e5327c1-2ba7-4a73-883f-1251f70332b7 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:32:27.255835 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-2e5327c1-2ba7-4a73-883f-1251f70332b7 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:32:27.262073 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2e5327c1-2ba7-4a73-883f-1251f70332b7 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:27.262902 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2e5327c1-2ba7-4a73-883f-1251f70332b7 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:27.263698 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2e5327c1-2ba7-4a73-883f-1251f70332b7 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:27.264946 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-2e5327c1-2ba7-4a73-883f-1251f70332b7 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:27.294995 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-2e5327c1-2ba7-4a73-883f-1251f70332b7 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045704 Nov 24 15:32:27.295683 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 576/1091] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:32:27 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 24 15:32:27.783142 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-acb2112f-8588-4402-9ac0-57a94b7d7d17 req-c6596b4a-0558-4f6f-ba35-acb9b2da328b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c58463f5-527b-475e-a4c9-ca70f2d5f00f", "tag": "974425b6-c12e-4d5b-a19b-b1237f431c83"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:32:27.784683 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:32:27.784683 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:32:27.792310 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-acb2112f-8588-4402-9ac0-57a94b7d7d17 req-c6596b4a-0558-4f6f-ba35-acb9b2da328b service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:27.792755 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-acb2112f-8588-4402-9ac0-57a94b7d7d17 req-c6596b4a-0558-4f6f-ba35-acb9b2da328b service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:27.803919 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-acb2112f-8588-4402-9ac0-57a94b7d7d17 req-c6596b4a-0558-4f6f-ba35-acb9b2da328b service nova] Creating event network-changed:974425b6-c12e-4d5b-a19b-b1237f431c83 for instance c58463f5-527b-475e-a4c9-ca70f2d5f00f on hv-cinder-80403 Nov 24 15:32:27.808563 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-acb2112f-8588-4402-9ac0-57a94b7d7d17 req-c6596b4a-0558-4f6f-ba35-acb9b2da328b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030025 Nov 24 15:32:27.809358 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 516/1092] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:32:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:32:28.307398 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-df599bf0-475c-4e78-90a9-e1967be3e822 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:32:28.308312 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-df599bf0-475c-4e78-90a9-e1967be3e822 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:32:28.315595 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df599bf0-475c-4e78-90a9-e1967be3e822 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:28.316110 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df599bf0-475c-4e78-90a9-e1967be3e822 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:28.317020 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df599bf0-475c-4e78-90a9-e1967be3e822 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:28.317514 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-df599bf0-475c-4e78-90a9-e1967be3e822 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:28.346115 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-df599bf0-475c-4e78-90a9-e1967be3e822 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042503 Nov 24 15:32:28.346672 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 577/1093] 10.222.0.66 () {58 vars in 1301 bytes} [Wed Nov 24 15:32:28 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 24 15:32:28.356764 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-348a92f5-d562-4bb5-ab76-04eb13971e9d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:32:28.357331 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-348a92f5-d562-4bb5-ab76-04eb13971e9d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:32:28.364463 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-348a92f5-d562-4bb5-ab76-04eb13971e9d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:28.364904 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-348a92f5-d562-4bb5-ab76-04eb13971e9d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:28.366100 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-348a92f5-d562-4bb5-ab76-04eb13971e9d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:28.366225 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-348a92f5-d562-4bb5-ab76-04eb13971e9d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:28.438146 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-348a92f5-d562-4bb5-ab76-04eb13971e9d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] HTTP exception thrown: Instance c58463f5-527b-475e-a4c9-ca70f2d5f00f is not attached to volume e8e4a10c-e248-4072-814b-9768e5746361 Nov 24 15:32:28.438744 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-348a92f5-d562-4bb5-ab76-04eb13971e9d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Returning 404 to user: Instance c58463f5-527b-475e-a4c9-ca70f2d5f00f is not attached to volume e8e4a10c-e248-4072-814b-9768e5746361 {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:32:28.439625 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-348a92f5-d562-4bb5-ab76-04eb13971e9d tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/os-volume_attachments/e8e4a10c-e248-4072-814b-9768e5746361" status: 404 len: 154 microversion: 2.1 time: 0.086906 Nov 24 15:32:28.440170 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 517/1094] 10.222.0.66 () {58 vars in 1415 bytes} [Wed Nov 24 15:32:28 2021] DELETE /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f/os-volume_attachments/e8e4a10c-e248-4072-814b-9768e5746361 => generated 154 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:32:29.564596 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-a125af6d-8545-4eba-8877-4251d1235329 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:32:29.565099 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a125af6d-8545-4eba-8877-4251d1235329 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:32:29.571353 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a125af6d-8545-4eba-8877-4251d1235329 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:29.571792 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a125af6d-8545-4eba-8877-4251d1235329 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:29.572557 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a125af6d-8545-4eba-8877-4251d1235329 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:29.572983 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-a125af6d-8545-4eba-8877-4251d1235329 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:29.597567 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-a125af6d-8545-4eba-8877-4251d1235329 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Going to try to terminate instance {{(pid=116072) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 24 15:32:29.672486 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-a125af6d-8545-4eba-8877-4251d1235329 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 204 len: 0 microversion: 2.1 time: 0.110615 Nov 24 15:32:29.673113 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 578/1095] 10.222.0.66 () {58 vars in 1238 bytes} [Wed Nov 24 15:32:29 2021] DELETE /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 24 15:32:29.680898 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-0d41cde1-3683-4208-8e3e-787854cbfd00 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:32:29.681505 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-0d41cde1-3683-4208-8e3e-787854cbfd00 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:32:29.687791 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0d41cde1-3683-4208-8e3e-787854cbfd00 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:29.688226 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0d41cde1-3683-4208-8e3e-787854cbfd00 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:29.688988 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0d41cde1-3683-4208-8e3e-787854cbfd00 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:29.689412 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-0d41cde1-3683-4208-8e3e-787854cbfd00 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:29.818948 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.policy [None req-0d41cde1-3683-4208-8e3e-787854cbfd00 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116073) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:32:29.826257 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-0d41cde1-3683-4208-8e3e-787854cbfd00 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1554 microversion: 2.1 time: 0.148879 Nov 24 15:32:29.826830 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 518/1096] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:32:29 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:32:30.844282 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f2e78581-40ca-41bf-828d-4d157639d826 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:32:30.844965 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f2e78581-40ca-41bf-828d-4d157639d826 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:32:30.851312 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f2e78581-40ca-41bf-828d-4d157639d826 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:30.851753 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f2e78581-40ca-41bf-828d-4d157639d826 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:30.852516 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f2e78581-40ca-41bf-828d-4d157639d826 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:30.852956 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f2e78581-40ca-41bf-828d-4d157639d826 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:30.986834 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f2e78581-40ca-41bf-828d-4d157639d826 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:32:30.994890 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f2e78581-40ca-41bf-828d-4d157639d826 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1554 microversion: 2.1 time: 0.154656 Nov 24 15:32:30.995452 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 579/1097] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:32:30 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:32:31.793192 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [req-8704c4bc-ba7b-4c43-a492-02685f2bff53 req-dfee35c1-366a-4f0c-94ce-b773f13058d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c58463f5-527b-475e-a4c9-ca70f2d5f00f", "name": "network-vif-deleted", "tag": "974425b6-c12e-4d5b-a19b-b1237f431c83"}]} {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 24 15:32:31.794773 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 24 15:32:31.794773 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: warnings.warn(msg) Nov 24 15:32:31.802384 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-8704c4bc-ba7b-4c43-a492-02685f2bff53 req-dfee35c1-366a-4f0c-94ce-b773f13058d1 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:31.802850 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [req-8704c4bc-ba7b-4c43-a492-02685f2bff53 req-dfee35c1-366a-4f0c-94ce-b773f13058d1 service nova] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:31.814658 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.compute.server_external_events [req-8704c4bc-ba7b-4c43-a492-02685f2bff53 req-dfee35c1-366a-4f0c-94ce-b773f13058d1 service nova] Creating event network-vif-deleted:974425b6-c12e-4d5b-a19b-b1237f431c83 for instance c58463f5-527b-475e-a4c9-ca70f2d5f00f on hv-cinder-80403 Nov 24 15:32:31.819778 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [req-8704c4bc-ba7b-4c43-a492-02685f2bff53 req-dfee35c1-366a-4f0c-94ce-b773f13058d1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030023 Nov 24 15:32:31.820500 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 519/1098] 10.222.0.66 () {64 vars in 1317 bytes} [Wed Nov 24 15:32:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 24 15:32:32.012565 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-f8cc1e6c-59f7-4c59-8ecc-89fb4144c1c3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:32:32.013129 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.compute.api [None req-f8cc1e6c-59f7-4c59-8ecc-89fb4144c1c3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116072) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:32:32.020194 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f8cc1e6c-59f7-4c59-8ecc-89fb4144c1c3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:32.020648 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f8cc1e6c-59f7-4c59-8ecc-89fb4144c1c3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:32.021459 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f8cc1e6c-59f7-4c59-8ecc-89fb4144c1c3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:32.021900 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f8cc1e6c-59f7-4c59-8ecc-89fb4144c1c3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:32.051484 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f8cc1e6c-59f7-4c59-8ecc-89fb4144c1c3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:32.051936 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG oslo_concurrency.lockutils [None req-f8cc1e6c-59f7-4c59-8ecc-89fb4144c1c3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116072) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:32.052388 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.objects.instance [None req-f8cc1e6c-59f7-4c59-8ecc-89fb4144c1c3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lazy-loading 'fault' on Instance uuid c58463f5-527b-475e-a4c9-ca70f2d5f00f {{(pid=116072) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 24 15:32:32.091814 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.policy [None req-f8cc1e6c-59f7-4c59-8ecc-89fb4144c1c3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de80792036a946fe8ca7c8abef2d5d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43561d39a3aa4b6390447a9f4f77d4e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116072) authorize /opt/stack/nova/nova/policy.py:199}} Nov 24 15:32:32.099400 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-f8cc1e6c-59f7-4c59-8ecc-89fb4144c1c3 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 200 len: 1348 microversion: 2.1 time: 0.090583 Nov 24 15:32:32.100383 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 580/1099] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:32:32 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 1348 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 24 15:32:33.118517 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-24f47ab5-9c0f-4dff-85df-6fa5fd745420 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '>' {{(pid=116073) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:32:33.119234 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.compute.api [None req-24f47ab5-9c0f-4dff-85df-6fa5fd745420 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] [instance: c58463f5-527b-475e-a4c9-ca70f2d5f00f] Fetching instance by UUID {{(pid=116073) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 24 15:32:33.125327 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-24f47ab5-9c0f-4dff-85df-6fa5fd745420 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:33.125768 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-24f47ab5-9c0f-4dff-85df-6fa5fd745420 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:33.126531 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-24f47ab5-9c0f-4dff-85df-6fa5fd745420 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 24 15:32:33.126993 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG oslo_concurrency.lockutils [None req-24f47ab5-9c0f-4dff-85df-6fa5fd745420 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Lock "394dac41-edff-43f6-a3ed-5e4ac19075b2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116073) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 24 15:32:33.139680 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.wsgi [None req-24f47ab5-9c0f-4dff-85df-6fa5fd745420 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] HTTP exception thrown: Instance c58463f5-527b-475e-a4c9-ca70f2d5f00f could not be found. Nov 24 15:32:33.140760 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: DEBUG nova.api.openstack.wsgi [None req-24f47ab5-9c0f-4dff-85df-6fa5fd745420 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Returning 404 to user: Instance c58463f5-527b-475e-a4c9-ca70f2d5f00f could not be found. {{(pid=116073) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 24 15:32:33.141573 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO nova.api.openstack.requestlog [None req-24f47ab5-9c0f-4dff-85df-6fa5fd745420 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f" status: 404 len: 111 microversion: 2.1 time: 0.027783 Nov 24 15:32:33.142372 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: [pid: 116073|app: 0|req: 520/1100] 10.222.0.66 () {58 vars in 1235 bytes} [Wed Nov 24 15:32:33 2021] GET /compute/v2.1/servers/c58463f5-527b-475e-a4c9-ca70f2d5f00f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 24 15:32:33.150428 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: DEBUG nova.api.openstack.wsgi [None req-0276280a-82f0-4e79-87c2-64af796f2bb2 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] Calling method '.version_select at 0x7f930cb65820>' {{(pid=116072) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 24 15:32:33.168172 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO nova.api.openstack.requestlog [None req-0276280a-82f0-4e79-87c2-64af796f2bb2 tempest-TestMinimumBasicScenario-645995211 tempest-TestMinimumBasicScenario-645995211-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-677945594" status: 202 len: 0 microversion: 2.1 time: 0.021417 Nov 24 15:32:33.168717 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: [pid: 116072|app: 0|req: 581/1101] 10.222.0.66 () {58 vars in 1268 bytes} [Wed Nov 24 15:32:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-677945594 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 24 15:33:07.799575 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 15:33:07.800270 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: Wed Nov 24 15:33:07 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 15:34:30.545734 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 15:34:30.546245 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: Wed Nov 24 15:34:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 15:34:35.952626 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 15:34:35.953472 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: Wed Nov 24 15:34:35 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 15:34:49.354715 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 15:34:49.355189 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: Wed Nov 24 15:34:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 15:34:58.815188 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 15:34:58.815188 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: Wed Nov 24 15:34:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 15:35:43.781682 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 15:35:43.782542 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: Wed Nov 24 15:35:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 15:36:27.816766 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 15:36:27.817383 dv-cinder-804035-20-iscsi devstack@n-api.service[116072]: Wed Nov 24 15:36:27 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 24 15:37:50.563540 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 24 15:37:50.564013 dv-cinder-804035-20-iscsi devstack@n-api.service[116073]: Wed Nov 24 15:37:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!